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ABSTRACT 

Written for teachers who want introductions to 
conducting school assessments and to studying features of writing, 
this book is intended (1) to provide ways for teachers to analyze 
writing sample£> and the writing process for school or program 
assessment, and (2) to promote the development of teacher research 
among kindergarten through grade 12 teachers by providing examples of 
different ways teachers can study writing in their classrooms. The 
first chapter presents an overview of procedures in teacher research. 
The next four chapters introduce various theoretical frameworks 
within which researchers have been working, with each chapter 
discussing a different level of analysis — syntax, text, information 
processing, and social context. The final chapter focuses on errors, 
teaching practices, and student attitudes toward writing. Appendixes 
contain information on the results of teacher research, evaluation 
designs for practitioners, sampling and statistical tests, and using 
expressive writing to teach biology. (EL) 
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Foreword 



The Educational Resources Inforniation Center (ERIC) is a national in- 
formation system operated by the National Institute of Education (NIE) 
of the U.S. Department of Education. It provides ready access to de- 
scriptions of exemplary programs, research and development efforts, 
and related information useful in developing effective educational 
programs. 

Through its network of specialized centers or clearinghouses, each of 
which is responsible for a particular educational area, ERIC acquires, 
evaluates, abstracts, and indexes current significant information and 
lists this information in its reference publications. 

ERKVRCS, the ERIC Clearinghouse on Reading and Communica- 
tion Skills, disseminates educational information related to research, in- 
struction, and professional preparation at all levels and in all 
institutions. The scope of interest of the Clearinghouse includes rele- 
vant research reports, literature reviews, curriculum guides and de- 
scriptions, conference papers, project or program reviews, and other 
print materials related to reading, English, educational journalism, and 
speech communication. 

The P:RIC system has already made available — through the ERIC 
Document Reproduction System — much informative data. However, if 
the findings of specific educational research are to be intelligible to 
teachers and applicable to teaching, considerable amounts of data must 
be reevaluated, focused, and translated into a different context. Rather 
than resting at the point of making research reports readily accessible, 
NIE has directed the cleavingiiouses to work with professional organi- 
zations in developing information analysis papers in specific areas 
within tlie scope of the clearinghouses. 

ERIC is pleased to cooperate with the National Council of Teachers 
of English in making The Teacher-Researcher: How to Study ^riting in the 
Classroom available. 

(Charles Suhor 
Director, ERIC/RCS 
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Introduction 



This book has two purposes, the first immediate and practical and the 
second long-range and global. The book's practical purpose is as a com- 
panion volume to A Procedure for Writing Assessment and Holistic Scoring 
(Myers 1980). It is, like that book, written for teachers who want an in- 
troduction to how to conduct school assessments of various kinds, and — 
to follow up thai, book — an introduction to what featur s of writing 
might be studied after the holistic scoring is complete. The first book de- 
scribed how a group of teachers could select a set of norms (anchor pa- 
pers) and score a population of papers holistically. Such an activity in a 
school district develops an awareness that broad agreement on mini- 
mum standards is possible and that a follow-up analysis of papers can 
provide useful information about why some students achieve the mini- 
mum standards anc son'f do not. 

This book, then, is -K.r .ressed first to teachers who want some ways to 
analyze writing sarr.'^lv s and the writing process for school or program 
assessment. The book's second, more global purpose is to promote the 
development of teacher research among K-12 teachers by providing ex- 
amples of different ways teachers can study writing in their classrooms. 
The two purposes are not separate. I regard funds made available for 
holistic writing assessment and feature analysis as the first serious com- 
mitment of a district to teacher research. The norms of a holistic assess- 
ment are already present in any interpretive communitv — a group of 
potential teacher-researchers, if you will. What needs to be done is to ex- 
tend this direction into classroom studies funded by a district as part of 
that district's overall assessment program. I would urge those teachers 
who plan to use this book as a source of ideas for school assessments to 
stop a minute and consider the importance of teacher research and the 
way school assessments can be used to help get funding for teacher 
research. 

The teacher-researcher movement now underway among K-12 teach- 
ers is an important part of a professionalization project in which class- 
room teachers are establishing their special expertise in teaching and 
curriculum development. In the National Writing Project and some 
teacher centers, for example, K-12 classroom teachers have become rec- 
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ognized as experts in lesson design, and these teachers have become 
consultants and leaders of staff development programs and instructors 
in university programs for teachers. The encouragement of research 
among teachers is an effort to define an important role for teachers in 
the development of theory, in the explanation of why some lessons work 
and others do not. 

The teacher-researcher movement among K-12 teachers has been 
around for at least thirty years. For me, the roots go back to Ben Rust, 
a social studies teacher in Richmond, California, who in the 1950s and 
1960s wrote monographs about how high school student.s learned world 
history, how master teachers should function, and how^ schools are 
staffed. Another source is Tom Gage, who in 1967, as English Depart- 
ment Head at Concord High School, in Concord, California, organized 
the first schoolwide holistic writing assessment in the San Francisco Bay 
Area. He introduced to his department the procedures developed by 
the Educational Testing Service and ways that teachers might assess the 
impact of particular curricula. Still another source is a 1975 publication 
of the New York State English Council entitled Emphasis: Teachers Doing 
Research, with an introduction by Charles Cooper In 1978, the publi- 
cations of the National Writing Project began, providing a major force 
behind the teacher-researcher movement in this country. In the United 
Kingdom, a major formative influence was Lawrence Sternhouse, who 
directed in the 1960s a series of teacher-researcher projects for the 
Schools Council. 

All teachers think about what happens in the classroom, but these 
thoughts are largely undocumented and unreported, and if they are re- 
ported they are usually anecdotal and only for lunchroom discussion. In 
brief, teacher research, because it is unplanned and undocumented, has 
no institutional standing, and, as a result, few districts provide paid time 
for teachers to do it; thus education is one of the few professions where 
expertise in how to do its tasks is assigned to people who do not in fact 
do them. Developing a research tradition among classroom teachers is a 
way of changing institutional roles and shifting more of the responsi- 
bility for teaching expertise to teachers themselves. 

This insistence on developing teacher expertise in the design of les- 
sons and in teacher research is not just a matter of professional poliucs. 
It is one of the most urgent needs for making schools better places for 
teaching and learning. Teacher research is one of the ways not only to 
inspire and renew teacher commitment but also to enable teachers to ap- 
preciate the complexity of their own classrooms. Present tests and in- 
struments used in school districts are largely inadequate for diagnosing 
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student needs, and, as a result, this information is almost never used by 
teachers for guiding instruction. 'leacher reseat h can provide a per- 
spective that can guide and inform instructioii. 

in addition, teadiers need some time in an adult environment to dis- 
cuss ideas and to develop new insights with their colleagues — to learn to 
be leanuM's again. .\s it is now, teachers seldom spend time with their col- 
leagues, and when they do the agenda is often set by someone else, anc\ 
is often focused on administrative or management details, not on lessc^ns 
or actual student performaiice. The question is liow^ we can promote and 
u.se teacher expertise as a part of the institutional life of the school. The 
school district workshops of the National Writing Project have shov/n 
that staf f development sessions run by classroom teachers and focused 
on the le.sson designs of those teachers can become a district's primal y 
resource in curriculum development. But teacher research is still not in- 
stitutionalized, that is, districts do not use or promote teacher research. 

Some people interested in teacher research talk as if teachers should 
assume research tasks as a professional obligation. These people are 
often themselves members of institutions of higher education that re~ 
ward research interests with commendations, promotions, and higher 
pay. Today, however, K— 12 classroom teacliers are not promoted, paid, or 
conmiended for doing research. 

The only exception to this rule is one area — assessment. Under min- 
imum competency statutes, many districts throughout the country have 
been willing to give teachers the necessary time to score and analyze stu- 
dent writing samples. I'his institutional setting provides an opportunity 
to promote funded research by teacliers. Just recently I watched a group 
of San Francisco teachers analyze the data tliey had collected in their col- 
laborative action research project, otherwise known in the district as the 
minimum competency assessment. They found, for instance, that the 
length (total words written) of papers from the bottom to the middle 
scores showed dramatic gains, but that length in the middle-to-top pa- 
pers showed only small gains, confirming the intuition of most of the 
teachers that an emphasis on length and fluency was not equally impor- 
tant for all students. 

It is indeed rare in such school assessments for teachers to have the 
opportunity to design assessment techniques, collect the data, and ana- 
lyze the results. School assessment methods, like classroom lessons, usu- 
ally come prepackaged. But holistic assessments, followed by feature 
analysis, provide a place for teacher research to begin in school districts. 
As an example of what might be done, t\vo additional steps were needed 
in the San Frarici.sco situation. First, specific teachers should have been 
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comniissionecl to write papers describing the results of the feature anal- 
ysis, and these tearhers should have been listed as the authors of the pa- 
pers. In present practice, someone in the district evaluation office writes 
the results, and the listed author is the superintendent or his/her deputy. 
Second, these papers by teachers should be in the distric t's professional 
library and should be cited by the district in its ofTicial reports. In this 
w*ay, the district will be encouraging teachers to transcend some of their 
individual perspectives through the intuitions and findings of their 
teacher colleagues. 

Basic and applied researchers often criticize the kind of research ini- 
der taken by the teachers in San Francisco. Some argue that teacher re- 
search is simply applied research done badly and that, for example, the 
San Francisco teachers .should not speculate about the trends in their 
data without submitting those speculations to statistical tests. From the 
point of view of the basic and applied researcher the significance of any 
statistical difference — for example, lengths of paper.s — must be deter- 
mined by the proper statistical procedures, not by eyeballing the num- 
bers. Yet classroom teachers have usually not been trained in the use of 
various "statistical tests, do not have people available with that expertise, 
and sometimes do not have the necessary computer capabilit)' to handle 
the numbers. 

How does one respond to the.se criticisms, and others like them, of 
teacher research? Dixie Cioswami, for one, solves the problem by defin- 
ing teacher research as ''naturalistic inquiry procedures which do not 
result in statistical data toward which journals of education are so heav- 
ily biased." In other words, solve the problem of numbers by applying 
the label ''teacher research" only to studies without numbers. This is the 
solution generally adopted by the teacher-research movement in this 
country and in the United Kingdom. 

Others solve the nmnbers problem by assigning to the teacher the role 
of a teacher-partner who works with a basic or applied researcher on a 
research project (Cjraves 1981, 111—12): 

The base of research involvement ninsi bo broadened to include 
an active role by the public school teacher. When the teacher be- 
comes involved in research, researchers not only gather better data, 
but the context of research — the public school classroom — is en- 
riched by the study itself. 'leachers and researchers ought to know 
each other better for the sake of research and the children. 

This is what the National Institute of Education and pn)St .schools of ed- 
tication mean by teacher research. Obviously, Ciraves is correct that basic 
and applied researchers should talk to teachers and form partnerships 
wheie appropriate, but 1 do not consider this a definition of teacher 
research. 
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The definition proposed here is the following: Teac/ur research is any 
study conducted by teachers of their sehool system, school, class, givups of stu- 
dents, or one student, either collaboratively or individually. But what do we do 
about the fact that most teachers do not know how to use statistical tests 
of significance that meet the standards of basic and applied researchers 
in schools of education? What we do, at least at this time in the historical 
development of teacher research, is adopt a different standard: Teacher 
research will be judged on the basis of its clarity of language, its organizational 
consistency, and its goodness-of-fit loith the intuitions of the teacher community, 
both in its definitiom of problems and in its findings. 

Research by teachers should not be limited to case studies without 
numbers or partnership roles for teachers, although both can be forms 
of teacher research. The point of the whole enterprise is to expand the 
teacher's role as a thinker about learning and teaching. Some of the ad- 
vantages of counts and numbers in action research are often overlooked 
by advocates of teacher research who fear that teachers will become *im- 
itative, pseudo-scientific" (Goswami 1984, 349), One of the advantages 
of numbers is that they allow many teachers to work together on a large 
project in which they pool data. Many teachers like to begin that way 
Another advantage is that in school assessments numbers are often what 
a district is willing to pay for, providing the necessary funding for pro- 
moting teacher inquiry into such things as the writing process. 

But the question still remains: How does one respond to the criticisms 
of basic and applied researchers? They define significance in terms of 
statistical tests, not an eyeballing of numbers; aim for generalizations 
about writing on many topics and in many settings, not just the school's 
selected topics and test settings; and, because they have research re- 
sponsibilities, have more opportunity to seek optimum solutions to re- 
search problems. These three norms of basic and applied researchers- 
tests of significance, generalizability, and optimizing controls of prob- 
lems — are defined somewhat differently by classroom teachers engaged 
in action research. This difference is the same as the fundamental dif- 
ferences Simon (1981) identifies between the science of design and the 
natural sciences. Teachers, like architects and engineers, are practition- 
ers of a science of design. 

The first difference, whether to eyeball numbers or to apply statistical 
tests, is a question of experience. First, teachers are not taught these 
tests, and basic and applied researchers are. Perhaps this should change, 
but, as far as I know, no teacher-preparation program in the country in- 
cludes introductory statistics as a required course. In any case, the sec- 
ond reason for the difference is even more important. This reason is 
based on the intuitions that result from experience. Because class- 
room teachers see up to ten times as many data each week as do uni- 
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versity researchers, tliese teachers can eyeball nunibers to estimate 
significance and leave the judgment of significance to the intuitions of 
fellow teachers who read and criticjue classroom research. That is, K-12 
classroom teacliers see nK)re students, and f rom this experience as mas- 
ter teacliers develop intuitions about broad patterns and trends among 
students, just as cliess masters develop pattern recognition about cliess 
moves (Simon 1981, 105-7). I'hus, when classroom teacliers eyeball 
numbers, they apply their intuition of broad patterns among students a?, 
a test of significance. This teacher intuition is, in fad, the primary test 
of significance in teacher research, and for this reason publishers of 
teacher research should have it reviewed before publication by a panel of 
teachers recognized as experts in classroom teaching. Such a test, of 
course, does not eliminate the use of statistical tests, which can be a 
means of objectifying and confirming intuitions. This test does, how- 
ever, raise very important questions about who is a teacher, particularly 
in grades K through 12. 1 would argue, for example, that only those who 
have taught in K-\2 classrooms full time for at least seven years should 
be allowed to list themselves as teachers. I'he others are assistant and as- 
sociate teachers, somewhat short of the desired expertise. 

Tlie second difference between teacher researc h and other basic and 
applied research in schools of education is the degree of generalizability. 
Teacher research has different goals and, thus, different standards of 
generalizability. Basic and applied researchers in education have set as 
their goal the answering of questions about writing on various topics and 
in various settings both in and out of school. They call this goal "the 
Gtudy of writing'as a multiple construct." Teacher-researchers in edu- 
cation, on the other hand, have set as their goal the answering of ques- 
tions about writing in response to some problem of lesson design in 
schools (How do students differ in the way they handle an assigned writ- 
ing task? How does this one student differ from others in the way he or 
she handles different writing assignments?). 

School lessons, like other design problems, usually "imitate appear- 
ances in natural things while lacking, in one or many respects, the real- 
ity of the latter" (Simon 1981, 8); as a result, although a lesson might 
attempt to imitate some writing experience hi natural events outside of 
school, the writing experience in the lesson remains a school c:onstruct. 
designed for certain limited goals within the budget and institutional 
constraints of the school. The lesson often results from interactions 
among parents, teachers, students, and the school board. Thus, findings 
from teachers have a dependence on context that cannot be escaped. Yet 
there are always findings that other teachers can adapt to their own cir- 
cumstances, and for this reason communities of teacher-researchers are 
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able to develop a body of shared knowledge. In any case, basic and ap- 
plied researchers should not criticize teacher-researchers for not treat- 
ing vvriting as a multiple construct, and teacher-researchers should not 
criticize basic and applied researchers for not providing lesson designs. 
The two types of researchers have different goals. 

The third difference between the teacher-researcher and the others 
IS that the teacher-researcher has fewer opportunities for optimum so- 
lutions to problems. For one thing, the teacher-researcher may know 
that a question about lesson design requires a particular kind of control 
or contrasting group, but the classroom teacher as action researcher is 
limited by circum^^fances to a particular classroom, school, or district. 
The teacher-researcher must be encouraged to proceed with what is at 
hand. For another thing, the classroom teacher may know that natural 
science says that the reliability of various counts of features in papers 
can be improved if each feature is counted twice and the two counts av- 
eraged, but the budget for the school assessment may not allow such an 
ideal or optimum solution. 

In such a situation, the designer "satisfices," according to Simon, se- 
lects a solution, that is, which "suffices" to get the job done and at the 
same time "satisfies" the need for a solution which, if not the best, is at 
least better than other alternatives. Says Simon, "No one in his right 
mind will satisfice if he can equally well optimize; no one will settle for 
good or better if he can have best. But that is not the way the problem 
usually poses itself in actual design situations" (Simon 1981, 1S8). The 
methods of feature analysis proposed in this book are not always the 
best, in the sense of satisfying all of the optimum experimental condi- 
tions called for in basic and applied research, but they are usually better 
than some other design alternatives, such as an item analysis of a mul- 
Uple-choice test on writing skills. Furthermore, in most instances, the 
methods described have been found to fit comfortably within the sur- 
rounding conditions in schools and to have been useful for some teach- 
ers attempting to understand learning and teaching in classrooms. 

The introduction of teacher research as part of the role of the class- 
room teacher must lead to changes not only in school districts but also 
in schools of education. In most schools of education, educational re- 
search is conducted for teachers inside K-12 classrooms by people who 
are outside the K-12 classroom and who may never have worked in a K- 
12 classroom. Teachers are trained in schools of education as consumers 
of this educational research, not as future producers of knowledge, and 
are taught that the experts in K-12 teaching are not K-12 teachers. An 
introduction to teacher research must become a part of teacher-prepa- 
ration programs. 
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This book is intended for teachers who want an introduction to 
teacher research. Many teachers will read it selectively, examining those 
sections that seem useful and ignoring those that do not. Probably the 
best approach is to use the book when one is engaged in a teacher re- 
search project. The book has an index so that the reader can return to 
areas that were not useful on one project but may be useful on another. 
The next chapter gives a brief review of teacher research procedures, 
and the chapters that follow give specific examples of various units of 
analysis — from syntax to social context. 
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In an article on teacher research, Nancie Atwell (1982) asks, "How can 
chissroom teachers acquire the background in language theory and re- 
search procedures to enable them to conduct full, naturalistic investi- 
gations of their students' writing processes?" The answer is "By doing 
it." This book is intended as a handbook for both getting started and 
keeping going. The way to begin as a teacher- researcher is to keep a re- 
search diary in which on-the-spot rehcLiims and questions are re- 
corded. This diary becomes the source of ideas for study The second 
way to begin as a teacher-researcher is to establish data-collection rou- 
tines in the classroom. These routines include using tape recorders to 
record teacher-student conferences, class discussions, and group work. 
In addition to using tape recorders, students should maintain portfolios 
of their writing both in and out of class. In these portfolios, one should 
find information about students' reading, written work, and out-of-class 
interests. If these data-collection metiiods become routine in the class- 
room, then the methods of a study will not intrude on the rhythm of the 
class. 

The research procedures outlined in this chapter provide some 
methodological background for beginning classroom research, but not 
all of these procedures will be possible or even appropriate for them. 
Furthermore, after a few attempts, other procedures not discussed in 
this book will begin to become important. What follows are four steps 
that have been helpful for teacher-researchers organizing a study of 
writing. 

Locating the Problem 

Select a problem that is interesting to you and lhat is found in your class- 
room, school, or school district. The problem may begin as a learning 
gap — a student is not doing as well as he or she should — or a learning 
jump — a student is making remarkabte progress. The problem usually 
begins as a question: "I wonder how this class compares to that one?" or 
"Why is that student doing so well?" or "What kinds of problems are 
holding these students back?" 



9 



ERIC 




10 



Ovennno of Procedures in Teacher Research 



Defining the Problem 

Model building in the social sciences requires two kinds of decisions, one 
theoretical and the other niethodoIogicaL Defining a problem is a the- 
oretical decision, and selecting a study design, the next section, is a 
methodological one. The definition of the problem requires that it be 
placed within some theoretical framework. For example, if one decides 
to study a student who is struggling to put letters on the page, then one 
might defin'^ the problem as a question of Huency or cognitive process- 
ing, (Cognitive theory provides several ways of defining the problem — 
how long are the sentences (I'-units) or discoiu'se units (total words) the 
student writes within a given time period, what kinds of revision doe^ 
the student make, and what are the stages, if any, in the student's com- 
posing process? The essential point here is to select those units of anal- 
ysis — length, revisions, stages, or whatever — that matter to you or to 
your fellow teachers. Do not select a unit Skmply because it is easy to see 
or count. 

It is a mistake to examine a feature without a coherent theory about 
what the feature represents, F.ven a bad theory is better than no theory 
at all because a bad theory will at least produce interpretations th ; » 
leagues can criticize and evaluate. Thoma.s Kuhn makes the p ^:i • ii 
new theories result from competition among theories and from rri • a- 
alies or phenomena that cannot be explained by a given theory (1963). 
Without any theory at all, the teacher-researcher is data-blind, iniable 
to see anything, either sense or non.sense. In the chapters that follow, 
theories are outhned for the various features suggested for analysis. In 
reports on school cHstrict assessments, these theories can help explain to 
school boards and others some of th^ goals of instruction. 

Because the theories in these cliapters overlap at some points — for 
example, text theories become cognitive theories about mental repre- 
sentation of texts — a combination of theoretical approaches might be 
more desirable. This kind of eclecticism is typical of much teacher re- 
search where the focus is primarily on learners in context, not the the- 
oretical framework per se. One way to combine different units of 
analysis is first to conceive of the research as a study of student writing, 
student attitudes or personality, or teaching techniques. Within student 
writing, there are product/structure studies or proce.ss/procedure stud- 
ies. A visual matrix or diagram can be a helpful way for a teacher- re- 
searcher to shape the theoretical framework imderlying the study. 

In the product/structure study illustrated in Hgure 1, the writer has 
two kinds of choices, one establishing social distance and the other shap- 
ing or modeling the form of the discourse. In social distance, the writer 
uses one of three social forni.s — conversation (expressive), report (artic- 
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Illation), and argument (conversion). Reports and arguments am be 
written either as presentations or as rituals, the latter establishing the 
greatest cHstance among writer, audience, and subject. 

In discourse modeling, the writer can select the form of the personal 
and expressive, the static (description and classification,^ the dynamic 
(narration and direction). The personal and expressive is a form largely 
coordinate in its structure, but static and dynamic models can range 
from coordinate to largely subordinate in structure. 

The matrix in figure I represents what a teacher might wish to stress 
in a composition program — a variety of structures or an emphasis on 
one. The next question is what units in the writing indicate the presence 
or absence of these different structures. What indicates coordination, 
subordination, static forms, dynamic forms, arguments, reports, ritu- 
als, presentations, and so forth? Examples of these indicators appear in 
the following chapter. After deciding what indicators to use in the study, 
the teacher-researcher can use these indicators to locate pieces of writ- 
ing on the matrix. In figure 1, the various dimensions of the writer's 
sample will intersect at one point. For example, the writer might pro- 
duce a static argument written in ritual form with a high degree of sub- 
ordination. This would place the sample in the upper left-hand corner 
of the matrix. 

A matrix or diagram can also be used to plan process/procedure 
studie . In figure 2, for example, a writing .sample can be located at four 
differ.Hit points on the matrix. The vertical line represents time for com- 
posing and prewriting, two different points, and the horizontal line rep- 
resents processing strategies, one point to the left for the size of sentence 
encoding and one point to the right for ) he size of discourse encoding. 
The assumption here is that the weights of time and length will help ex- 
plain the writing proce.sses of students. Do some students spend no time 
on prewriting and little time on final drafts? What effect does this have 
on lengths of discourse and sentences? 

One way to diagram the interaction of two variables is the scatter- 
gram. In figure ?>, for instance, a writing sample that received a grade 
of SO points and was preceded by 50 minutes of prewriting becomes 
data point A on the scattergram. The patterns of the data points suggest 
the relationship between the two variables. In figure 3, there appears to 
be no systematic relationship. In figure 4, grade points increase as pre- 
writing time increases, suggesting that prewriting may contribute to an 
improvement in the quality of the writing, while in figure :*), grade points 
go down as prewriting increases, suggesting that the prewriting these 
students do may contribute to a decrease in the quality of tfie writing. 
What needs to be examined is whether the prewriting or the grading 
differs between the two classes. 
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Later chapters will present examples of other diagrams that teacher- 
researchers can use to shape the theoretical outlines of their studies and 
to examine results. Chapter 5, for example, has a matrix showing the in- 
teraction of teaching practices and the personality needs of students. 
This matrix guided the study of Ada Hill and Beth Boone, teacher-re- 
searchers from Virginia (Hill and Boone 1982). It is important to re- 
member that a theory is only a way of sorting out possible answers. It is 
not necessarily the answer So, too, a correlation is not a cause. Simply 
that students with high SAT scores have more bathrooms at home does 
not mean that more bathrooms produce higher SAT scores. However, 
more bathrooms may have an association with something that is a pos- 
sible cause. For instance, more bathrooms may be associated with fam- 
ilies who have the money to hire SAT tutors for their children. The rule; 
when it comes to causal relationships, use might be, not z>. 
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Figure 4 



Selecting an Overall Design 

Design is the methodological approach to problem definition, and in a 
sense problem definition and design cannot be separated. At least three 
overall designs are available: rationalism, positivism, and contextualism. 
Each of these designs takes a different approach to the key concerns of 
significance, reliability, and validity. Significance is a question of impor- 
tance— Is the result a matter of chance or does the result matter to any- 
body^— and reliability refers to the likelihood of obtainmg the same 
answer if one were to measure the same thing twice. Validity has two as- 
pects and requires that the identified variables m a research project be 
variables existing in actual human events. Internal validity requires that 
the data come from an authentic setting, and external validity requires 
that the findings be generalizable to other groups in nmilar settings. 
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Figure 5 
Rationalism 

In a rationalist design, the teacher-researcher examines contrasting 
pieces of data and uses the logic of reason and the insight of intuition to 
make claims about the significance, reliability, and validity of a hypoth- 
esis. One key feature of rationalist research is that the findings are not 
embedded in a particular context. For example, Chomsky examined two 
contrasting sentences ("John is easy to please" and "John is eager to 
please") and hypothesized the existence of a deep structure in which the 
two sentences had different subjects ("Somebody pleases John" and 
"John pleases somebody"). Chomsky attempted to describe a model of 
innate competence by describing the contrasting surface data of per- 
formance (Chomsky 1965). 

In another example, Cicero, in De Oratore, contrasted the parts of 
written texts and found the existence of 5uch forms as exordium (intro- 
duction) and perporaiio (summing up). Likewise, Francis Christensen 
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and Bonniejean Christensen (1978) analyzed contrasting paragraphs 
from professional writers and found three forms of organization (co- 
ordinate, subordinate, and mixed) and three sentence additions (nouns, 
adjectives, and -ed/-ing verbs) in what they identified as the cumulative 
sentence. In each of these rationalist approaches the test of an idea's va- 
lidity is the logical consistency of the argument and the reader's recog- 
nition of the examples as representative of his or her general experience. 

An example of rationalism in teachei' research is an examination by 
Gail Siegel et a'l. of sequences of instruction, K-i3: "I find it useful to 
view young writers as passing through a series of developmental stages: 
(1) Transcribing Stage, (2) Re-copying Stage, (3) Sentences/Whole 
Phrases Stage, and (4) Independent Stage. The stages aren't rigid; they 
have soft edges" (Siegel et al. 1980, i). Ms. Siegel, a teacher at Reed El- 
ementary School in Tiburon, California, does not place her speculations 
in a particular class. She talks in general about what her experience in 
teaching young children tells her about their developmental patterns. 

Positivism 

In positivism the test of an idea's reliability is the numerical weight of 
the descriptive statistics. Descriptive statistics ave the mean (the aver- 
age), the mode (the most frequently occurring point), and the median 
(the midpoint). The numerical weight of descriptive statistics is mea- 
sured by inference statistics. The inference statistics are the t-test and 
the chi-square, among others, and they can tell us to what degree the 
numerical results are a matter of chance. What is chance? Among other 
things, chance can be the amount of error which can result when one 
averages scores with a great range and diversity, or the limits of esti- 
mation when the sample size is small. 

Most writing researchers are willing to accept a 5 percent risk of 
chance results. That is, if the probability of chance results can be re- 
duced to one out of twenty, then the writing researcher will accept the 
result as statistically significant. The probability of exceeding 5 percent 
risk of error can, of course, be reduced by increasing the number of 
data. If the number is big enough, the result will represent the world as 
it is, not chance based on a limited sample. 

If you are using score averages to compare groups, ask your school 
research department to help you apply a test of significance to the dif- 
ferences. If you want to try a statistical test, then see the section on sta- 
tistics in appendix C. It is important to remember that a result may be 
statistically significant, not a matter of statistical chance, and at the same 
time not be experimentally significant. Experimental significance re- 
quires that the subjects in a writing experiment be randomly assigned 
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to different experimental treatments, matching the subjects and the sit- 
uation on all the variables except the key one for the experiment. These 
experimental controls are very difficult, if not impossible, for most 
teacher-researchers, working as they do in actual schools and class- 
rooms, and teaciier-researchers wlio use matching-group designs 
should simply acknowlecige the difficulties and indicate the areas where 
matching may not have occurred, A typical matching design that con- 
trols for the fact that topics may not be perfectly matched in pre-post 
comparisons is shown in figure 6. 

Appendix B is a section on evaluation designs by Eash, Talmage, and 
Walberg, leachers who wish to use a positivist approach to evaluation 
will find in this section an outline of four possible designs: (i) a true ex- 
perimental design in a field setting, (2) a nonecjuivalent control group 
design, (!^) a time series design, and (4) a no-comparison-group design. 

One of the major problems in positivism is validity. The reason for 
this is that most studies have to exchange validity for reliability or vice 
versa. In positivism, the emphasis on reliability, using high standards 
for controlling and numbering data, leads to a loss of validity. The data 
are reliable, but they look less and less like actual classroom experience. 
In the design below, the effort to get two matching topics may lead to a 
topic that is not typical of classroom experience, and the split in the class 
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Figure 6, Matching-group design with controls for topics that may not he perfectly 
matched. 
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between topic A and topic B may reduce the between-student exchanges 
ot informadon and assistance typical of classroom wridng. 

In wriung research, the studies of Batenian and Zidonis (1966) and 
Mellon (1969) are examples of poskivism, both using control and ex- 
perimental groups to test die hypothesis that instrucdon in grammar or 
sentence combining increases what Mellon calls "syntacdc maturity" and 
what B a tenia n and Zidonis call structural complexity." Frank O'Hare 
(197?), also using control and experimental groups, examined not only 
whether sentence-combining instruction of his design would increase 
syntactic maturity but whether teachers would give higher ratings to 
tliose papers with syntactic maturity. 

For teacher- researchers, the posiuvist design has serious limitauons. 
Teachers have not been trained in statistics and experimental design and 
their attempts at a positivist design are certain to fall below the stand- 
ards set by basic and applied researchers. Even so, I am suggesting that 
teachers attempt such studies if thev desire to do so and that teacher- 
researchers adopt, at least for the present, a different standard of esti- 
mation. Teacher-researchers should be allowed in their studies to eyeball 
numbers, depending on the intuition of readers for judgments of the 
overall acceptability of the results. In other words, for teacher-research- 
ers, posiuvist studies will be largely interpretive, not strictly empirical. 
In ume, as the professionaiizauon of teachers increases, more and more 
of tiiem will have better training in statistics and experimental design — 
a training quite different from that given to basic and applied research- 
ers — and at some later date the community of teacher-researchers may 
wish to adopt more rigorous standards for positivist research by teach- 
ers. For the present, the prevailing standard for posiuvist designs by 
teacher-researchers is represented by such studies as Robert Tierney's 
(see appendix D for a full report). 

Tierney's study is an examinaUon of two ways of teaching high school 
biology, one in an experimental group with many wriung experiences 
and the other in a control group with little or no wriung (1981, 52): 

Kxperimenlal G rou p Control Group 

L reading logs I. no reading logs 

2. neuron notes 2. no neuron notes 

3. practice essays H. no practice essays 

4. writing to a specific audience 4. writing to the teacher as an 
other than the teacher examiner 

5. end-of-class summaries 5. no end-of-class summary 

6. group writing 6, limited group writing 

7. essay tests 7. multiple-choice tests 
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During the first semester, Tierney, a biology teacher at Irvington 
High School in Fremont, California, taught the experimental group, 
and another teacher taught the control group. During the second se- 
mester, Tierney taught the control group, and the other teacher taught 
the experimental group. Tierney found that although the pre-posttest 
differences between the two groups were mixed, the experimental 
group consistently did better on the recall tests, which were given sixteen 
weeks after the first unit and three weeks after the second, 

Tierney examines students in two classes, but sometimes teacher-re- 
searchers want to examine a sample of students from many schools and 
at the same time claim that the sample represents the population in the 
schools. In order to select a sample representing the population, one 
must use random sampling methods. These methods ensure that every 
possible sample of a particular size has an equal chance of being selected 
from the population. A group of volunteers, for example, is not random 
or representative of the total population because volunteers may only in- 
clude those students who want to please the teacher and get the best 
grades. 

One commonly used random sampling procedure is to number die 
students in the population, using the roll book numbers in the class plus 
a different number for each class; turn to the table in Appendix C, close 
your eyes, and put your fmger on the page, the beginning digits in the 
first number you touch being the first student in the sample; and then 
move three numbers left or right, up or down, for the next student, con- 
tinuing this procedure until you have your sample. 

Contextiuilism 

Contextualism is the third methodological choice. Although positivism 
has been the dominant method of re.search in writing, an increasing 
number of researchers has started to criticize the positivist assumption 
that in the pursuit of general laws in the social sciences one must strip 
away context and put subjects in an experimental or laboratory setting. 

Contextualism differs from positivism in that it examines subjects in 
their natural settings without imposing any experimental constraints 
from the outside. For example. Graves (1975) began his study by ex- 
amining the writing folders of ninety-four students in four classrooms, 
finally arriving at a tentative three-phase structure for the writing pro- 
cess (prewriting, composing, and postwriting). Next he observed fifty- 
three writing episodes in four classrooms, and finally he gathered data 
on one student, including interviews with parents. C.ontextualism differs 
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from rationalisni in that contextualism examines writing as an evolu- 
tionary process, collecting data over extended periods of time in a "nat- 
ural" context, whereas rationalism examines writing as a product, 
collecting examples of the end result. 

Wallace CHiafe's work is an example of contextualisni, and Northrop 
Frye's is an example of rationalism. Chafe (1980) examined story struc- 
ture by showing subjects in a six-minute film about a boy who steals a 
kLsket of pears from a man and then asking subjects to tell "what hap- 
pened in the film." Chafe focused on how stories evolve in a given con- 
text. Frye (1057), on the other hand, collected what he considered a 
representative number of completed stories and then described the cat- 
egories into which the stories might fall (romantic, ironic, and so forth). 
The difference is the same one that David Olson believes separates 
Chafe and Chomsky. Olson (1977) says that Chomsky believes that lan- 
guage is best represented by the written text, and Chafe believes that 
language is best represented by oral conversational utterances. 

Contextual studies can be clinical or episodic. The clinical approach, 
used by Jean Piaget and Barbel Inhelder in their study of a child's con- 
cept of conservation, requires the researcher to give the student the 
writing problem. Chafe's study, described above, and Janet Kmig's 
(1971) are other examples. Emig asked eight students, selected by teach- 
ers, to write about a person or event. She then asked these students to 
discuss what writing they liked to do, how they usually went about their 
writing tasks, and what writing conditions in school were like. 

The episodic study is one like Claudia Mitchell-Kernan's 1972 study 
of black discourse in Oakland, California. She recorded conversations 
heard in her neighborhood and selected particular episodes for study, 
for example, the situation in which a speaker ''puts down" another per- 
son. Other examples are William Labov's 1972 study of oral narratives 
told on Harlem street corners and his 1977 study with David Fanshell of 
the discourse used in therapy 

Sometimes episodic studies try to show the kind of language used 
during a particular part of the school day. Jenny Cook-Gumperz, John 
Gumperz, and Herbert Simons (1979) have described procedure.s that 
natural science researchers often use in order to do an episodic study of 
language in a school setting: 

L Selection of fieldwork site: The people who work at the site must 

be willing to be evaluators of data. 
2. Observing the organization of the school day: Because the study 

of language in school settings describes events over time, the time 

framework must be segmented in some way The segmentation 

might be the school bell schedule. 




Ovennm of Procedures in 'Imchet' Research 



21 



3. Iclentitying activity grouping: Observations of the class and in- 
terviews with teachers will help the observer to group activities. 
An example would be art time (drawing pictures) and storytelling 
(or show and tell). 

4. Selection of key episodes: 'I'liese episodes will be those that seem 
to reveal something interesting about the writing process. For in- 
stance, one mii;ht select all incidents of miscommunication, the 
teachers method of assigning writing, or the kinds of stories chil- 
dren develop in their prewriting and art. 

At other times, episodic studies ti y to show how language varies from 
one writing assignment to another. These are assignments selected by 
the teacher, not the researcher. At still other times, the episodic study ex- 
amines writing in geu^*ral in the classroom, no matter what the assign- 
ment. An example of this kind of episodic study is Kellogg Hunt's study 
(1965) of how many clauses children at different ages could consolidate 
into a single sentence. Hunt collected one thou.sand words from each 
student. Each writing episode was part of the normal coursework and 
free of any control from Hunt. His findings showed, for instance, that 
the average eighth grader could consolidate five clauses, the average 
fourth grader only three. 

Another example of an episodic: study is Anne Haas Dyson and Celia 
(ienishi's ex'^mination of cooperative exchanges between students writ- 
ing in the elementary classroom. Their approach is to present the data 
and then to offer some po.ssible generalizations about them (1982, 129): 

Tambrea appeared to feel a responsibility or a desire to teacli, to 
share her writing ability with lier peers. For example, in the fbilow- 
ing interaction, Peter begins by asking Eva for lielp, but 'lambrea 
quickly intervenes: 

Pe ter : He )w do yo u s pell ha vef ( Pe ter d i rec ts the q ues tion 

to Eva.) 
lanibrea: I think I know. 
Peter: You do? 

lanibrea: 1 think. I tii ink. Anyway, wliatta ya try! if to write? 
Peter: Fni writing about my picture. (Peter shows his 

photo to Tambrea.) 
'lambrea: I know, but whatta ya tryin' to write? 
Peter: Right liere, my picture. (Peter sounds irritated.) 
Tambrea: Wliatta ya tryin' to write, anyway? 
Peter: ''I have a picture of a cat in niy house." 
Tambrea: What do you want to write? (lambrea now sounds 

irritated.) 

Peter: 1 want to make "I have (unclear)." (Peter points to 

a word on his paper.) 
Tambrea: Um kay. Just put an .9 (sic) and tlien 
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Peter finally realized that Tambrea was using write as a synonym for 
spell and showed her what word he needed to know. 

While Tambrea composed the following story, she offered un- 
solicited advice twice, but oUier children's appeals interrupted her 
four times. 

An example of a clinical contextual study in teacher research is Ada 
Hill and Beth Boone's 1982 study of the relationship of Abraham Mas- 
low's pers' )nality theory to writing. The scales that they gave students 
were not natural parts of a writing class, btit were presented in the class 
setting as a way of estimating personality development, very much the 
way Piaget presented children with a task in order to estimate their in- 
tellectual development. The scales did, however, use tasks from the class- 
room setting as a basis for estimating personality development. 

The episodic contextual study is represented by the studies of Nancy 
Marashio, a teacher of eighth graders at Center School in Windham, 
New Hampshire, and Jerry Herman, a teacher at Laney Community 
College in Oakland, California, The difference between the two is that 
Jerry Herman is studying a single case, and Nancy Marashio is studying 
116 eighth graders, Herman (1979) is describing the work and reactions 
of a single student at various points in the student's visits to the college 
tutorial center. Marashio (1982) is describing the responses of students 
in different classes in a particular school to the panic of a first writing 
assignment, their strategies for giving their writing structure, and their 
evaluations of their own wriung. Marashio presents examples and illus- 
trations of what she believes are general patterns, but she does not at- 
tempt to crunch numbers into averages and percentages, as does 
Tierney. The "Try Scale" of student Pete Bolin is one example Marashio 
presents— in this case, an example of a student's strategy for controlling 
his own writing processes (1982, 61): 

I base my writing on a scale. I call this scale my try scale. I base 
my try scale on these tries. 

1. 1 try to write on the subject given every week. 

2. I try to put my ideas together. 

3. I try to write things that interest me while staying in the 
boundaries of the subject given. 

4. I try to make my themes a little funny. 

5. I try to make a 4 theme, but that isn't always so. 

6. I try to use my try scale. 

I made this scale to model the way 1 write themes. Those tries are 
how I model myself. I use this try scale most of the time. 

Limitations and Future Questions 

Try listing during the study the things the study did not try to do and 
the modifications you would make if you did the study again as ideas oc- 
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cur to you. For example, one problem in many cross-sectional studies (a 
comparison of third graders and tenth graders on a given writing as- 
siginiient, for instance) is that they are not, strictly speaking, studies of 
chronological development. Yet school districts like to compare different 
grade levels and then to claim that grade-level differences are devf^If)p- 
nientaL Some teacher-researcher somewhere should convince a district 
that it should assess a single group of students over a k)ng period of time. 
A notable example of such a study is Walter Loban's study of 211 stu- 
dents from kindergarten through the twelfth grade in the Oakland Un- 
ified School District, Oakland, (lalifornia. 

It is helpful for other teacher-researchers if the list of limitations is 
translated into other kinds of research cjuestions which they can pursue 
in their classrooms. When teachers analyze [)apers in the school district 
assessment, their final comment is often "Next year let's look at " 

Most school district assessments involve teams of teacher-researchers, 
but most school site studies involve only one or two teachers. Further- 
more, nine out of ten studies by teacher-researchers are case studies of 
one or two students. Donald Graves has made a suggestion that depth 
needs to be added U) school site studies, using case, ethnographic (or 
contextual and episodic), and experimental (positivist) approaches 
within ihi^same study. This kind of study, outlined by (h aves (1981, 110- 
11) bek)w, will require a team effort and could provide the framework 
for a u.seful department or grade-level pr()ject: 

Depth needs to be added through diiTereni u.sc of (a.sc, cxjjcniiicn- 
laL and ethnographic procedures xinihin the same study. In shoit, the 
space-time dimensions of re.search must be expanded to include 
procedures in the same study that in the past have been used solely 
for one type of study alone. An example of such a study focusing on 
children is contained in Figure 1!^ 
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111 sucii a design, (UiUi are gatliered siiiiultaiieously al four levels 
of investigation: intensive process data tlirougli direct observation 
of the child at Levels I and 2 over at least one year's time, and the 
full context of writing episodes are gathered from before the child 
writes until the child has had a res[)onse to the product. The child 
in Level 1 is a writer who gives more than the usual amount of in- 
formation, involves a broader spectrum of developiiieiit, and there- 
fore merits more time from the researcher. Level data come from 
the entire class in which Level 1 and 2 children reside. Some infor- 
mal observations are taken from them but all of their products are 
classified or duplicated for examination. Finally, product analysis is 
af)plied to four classes within the same school building, including 
each of the first three levels of the study. In this way, jjroduct aiial- 
vses of larger groups can be further investigated for their process 
implications in the case study data. Similaily, case data variables 
that appear to be pivotal can be examined through interventions or 
product analyses at Levels \\ and 4. To date, three studies have been 
done in this manner: (;raves { 197a)( 1979-80) and Calkins ( 1980). 

Depth must be added through more intensive case studies with 
intra -differences (within the child dif ferences) explained through 
one case. One child's behavior is described within the context of at 
least one to three years. In ibis way, the pattern of developinfMit 
within one variable or across variables can be examined and ex- 
plained over a much longer jjeriod of time, loo of ten research con- 
tributes to a lottery f)hilosophy of educating, That is, we look for 
similarities across children, ways of generalizing one child's behav- 
ior to aid other children. I'here is a value in this, but there is also a 
grave, potential weakness. We will look too quickly to see why the 
child before us is the same as other children rather than look at how 
the child is dif ferent. Or, il" thedifference is located, we seek to ex- 
tinguish it in order to integrate llie child into a homogeneous mass 
for more convenient instruction. 

In short, we tend to overlook the one thing that makes the child 
dif ferent, unique. We tend to overlook the voice — the one experi- 
ence or knowledge area the child knows well. (k)od teachers have re- 
sponded to this uniqueness on an intuitive basis for years. Research 
neecU, to document intra-dif ferences of the components that make 
children unique, (ilenda Bissex (1980), in her study of Paul over a 
five-vear peiiod, conducted this type of study, .Also, the child in 
Level 1 (Figure 13) is a potential type for study of intra-differences. 
Data gathered in such depth usually point the way to discovering 
new variables not seen in the larger data gathering. We cannot af- 
ford to be without such studies. 



The Write-Up 

I'he write-up of the study should begin with some background about 
why the issue or question of the study became important to vou in your 
classroom. It is important at this poiiu to cite the insights of other class- 
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room teachers whose previous work, whether in the form of teaclier re- 
search, lunchroom conversation, or ditto sheets, has been helpful. This 
beginning step, if it becomes a convention in teacher research, will help 
to establish in writing the network of a professional community of teach- 
ers and to provide for classroom teachers a history of their ideas. That 
history has largely been lost because teachers have not recognized their 
professional roles as writers and experts in lesson design. 

In addition, the write-up should explicitly describe the design of the 
study, and enough data should be made available so that the reader can 
make some kind of independent judgment of the results. If possible, al- 
ways attach samples of student work. 

Chapter Summary 

1. Start a research diary. 

2. Establi.sh data-collection routines in the classroom such as port- 
folios and tapes. 

3. Locate the problem in general experience, a school district, a 
school, a class, a student, or a group of students. 

4. Define the problem within a theoretical framework (e.g., syntax, 
text, information processing, social context, personal psychology) 
and use diagrams, where helpful, to map interactions. 

5. Select a research design: 

a. Rationalism: (1) Select paradigm or norm. 

(2) Identify data suggesting norm or 
paradigm. 

b. Positivism: (1) Define unit to be studied. 

(2) Identify a treatment (lesson variable) that 
might have an interesting influence on unit 
to be studied. 

(3) Match groups and other variables so that 
one can see the variation in the unit to be 
studied when the treatment is applied. 

c. Contextualism: (1) Identify unit to be studied. 

(2) Identify context of the unit, either the nor- 
mal episodes that have the unit or the clin- 
ical test that will elicit the unit if the test is 
inserted into the normal context. 

6. Do the study. 

7. Present the background of the study, the data, and an interpre- 
tation of the results. 

8. Identify the limitations and unanswered questions in the study. 
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Each of the next four chapters introduces various theoretical frame- 
works within which researchers have been working. Each chapter dis- 
cusses a different level of analysis— syntax, text, information processing, 
and social context. The final chapter focuses on errors, teaching prac- 
tices, and student attitudes toward writing. Within these levels, different 
features are identified, and the dieory surrounding each feature is 
briefly described. The place to begin for teacher-researchers is replica- 
tion. If you find a feature and theory of interest, replicate in your class- 
room the study of another researciicn This is a way not only to 
contribute to our knowledge about English education but also to learn 
how research is done. The chapter that follows examines features within 
two theories of syntax — transformational grammar and case grammar. 

1 Feature: Syntactic Maturity or Fluency 

Theory: Transformational Grammar 

Chomsky argues that there is a single ideal of language competence, 
based on "an ideal speaker-listener in a completely homogeneous speech 
community" (1965, 3), and that this ideal reflects universals of all lan- 
guage and fundamental operations of the human mind. It is at the level 
of syntax, he says, that the language reveals most clearly that it is rule- 
governed and not arbitrary He suggests two sets of rules as primary: 
phrase structure rules for inserting words from a mental dictionary into 
sentence slots in deep structure, and transformation rules for adding, 
deleting, and moving material around in deep-structure sentences and 
thereby producing surface structure. In this way, two deep-structure 
sentences such as "The man is winning" and "You know the man" can 
become the single sentence "Is the man whom you know winning?" 

Chomsky argued that structural linguistics, the grammar that pre- 
ceded transformational grammar, did not account for the differences 
between such sentences as "John is easy to please" and "John is eager to 
please" because structural grammar analyzed only the common surface 
structure of the two sentences — noun-verb-adjective-infinitive — not the 
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deep structure where transformations had taken place. In the deep 
structure of the first sentence, someone who does not appear on the sur- 
face is trying to please John ("John is easy to please"), but in the deep 
structure of the other sentence, John is the subject eager to please some- 
one who does not appear on the surface ("John is eager to please"). 

What Chomsky did for the teaching of composition was shift atten- 
tion from the surface structure to the history or processes which pro- 
duced the sentence. Some of these processes, particularly 
transformations that consolidate and embed clauses, are reflected in the 
length of Kellogg Hunt's T-unit, which is a main clause and all of its 
modifiers. Hunt (1965), examining what he called "syntactic maturity" 
in the writing of adults in Harpn's and Atlantic magazines and of fifty- 
four students in grades four, eight, and twelve, found that adults have 
longer T-units (more words per T-unit) and a larger ratio of clauses to 
T-units, a mea.su re of subordination. 

Hunt's study raised the question of whether or not special lessons in 
different sentence transformations might not accelerate the growth of 
syntactic maturity in students. John Mellon (1969), labeling this growth 
"syntactic fluency" instead of "syntactic maturity," found that sentence 
combining practice did indeed lead to growth, but he also found that 
students who improved their syntactic fluency did not necessarily receive 
higher essay scores than students who had not improved. Frank O'Hare 
(1973), on the other hand, modifying Mellofi's exercises slightly, found 
that both essay scores and syntactic fluency im[)roved as a result of direct 
instruction in sentence combining. These studies and others have over 
the past ten years helped give direction to an increasing number of 
teaching approaches emphasizing sentence combining. 

LesMm: Sentence Combining 

Lessons in sentence combining are not the same as most lessons with di- 
rect instruction in conventional or transformational grammar Mellon 's 
study, for instance, specifically says, "The growth produced by the sen- 
tence combining treatment represents a significant enhancement of nor- 
mal growth, regardless of whether the latter is defined in a curriculum 
environment featuring conventional grammar, or in one with no gram- 
mar study of any kind" (MeHon 1969, 62). In any event, most schools that 
teach sentence combining consider such lessons part of the grammar 
program, and typically sentence combining is used for ten or fifteen 
minutes each day, each lesson presenting a particular problem and each 
problem somewhat harder than the previous one. 

There is some debate about what sentence combining actually 
teaches. Mellon, for instance, observes, "In a word, the differences be- 



ERIC 



32 



Syntax 



29 



tween mature and immature writing are a result more of elaboration 
than of condensation" (Mellon 1969, 58). In other words, students are 
not combining what they would formerly have written separately; they 
are elaborating more on what they are writing. The students may have 
a tacit knowledge of various linguistic operations but not exercise it. In 
such a view what is being taught and learned in sentence combining is 
surface structure combination, not transformations of deep structure. 
Sentence-combining lessons tend to vary in their cuing systems. Some 
early materials follow closely the models used by Mellon (Brown and 
White 1968), Other materials use O'Hare's modification of Mellon's 
cuing system, changing six of Mellon's grammatical terms to the actual 
morphemes used to make a given transformation. For instance, T-infi- 
nitive in Mellon becomes in O'Hare FOR + TO, William Strong made a 
major contribution to teachers when he dropped the cuing system alto- 
gether and put the sentences in the context of larger pieces (Strong 
1973). 

Topic and Test Conditions 

Teacher-researchers should remember that the subject matter of, and 
preparation time allowed for, writing assignments can have an impor- 
tant effect on the syntactic features of the writing produced. On the is- 
sue of subject matter. Hunt found that 'Tourth graders wrote stories that 
told what people said; the twelfth graders wrote about what Pope be- 
lieved and Huxley believed about the state of mankind. Fourth graders 
don't ordinarily write on such subjects. , , , The shift in noun clauses is 
linked to maturity by being linked to subject matter" (1965, 151), Mellon 
has made a similar argument, suggesting that because their perceptions 
of the world become elaborated in different ways as students grow older, 
changes in structure may primarily reflect changes in subject matter 
(1969), 

On the issue of testing time, Eleanor Keenan found substantial dif- 
ferences between the syntax of planned and that of unplanned dis- 
course. In unplanned discourse, which does not require planning time, 
she found fewer subordinators such as z/and because (Keenan 1978), sug- 
gesting that extra planning time may contribute to more frequent use of 
subordinators. If syntactic features are to be counted in an assessment, 
then the topic and planning time must be carefully considered. The 
problem for the assessment designer is that although more "academic" 
topics may generate more heavily embedded sentences in the writing of 
some students, such topics may not reflect the topics used in typical les- 
sons or the topics designated as important by community committees 
and boards deciding school goals. 
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Coding of Features and Patterns of Use 

The features listed below are some of those that have been used to es- 
timate how much students consolidate and embed their clauses: 

Length of T-Unit 

The T-unit is a main clause and all of its modifiers. All of the following 
are T-units (from Hunt 1965, 21): 

a. 1 like the movie we saw about Moby Dick, the white whale, 

b. The captain said if you can kill the white whale, Moby Dick, I will 
give the gold to the one that can do it. 

c. And it is worth sixteen dollars. 

d. They tried and tried. 

Mellon used the following decision rules for his T-unit counts, follow- 
ing essentially the same procedure used by Hunt (Mellon 1969, 43): 

1. Each independent clause, including all constituent construc- 
tions, counts as one T-unit. 

2. Clauses of condition, concession, reas-on, and purpose (although 
traditionally considered constituents of independent clauses) 
also count as separate T-units. 

3. Independent clauses occurring as direcdy quoted discourses 
count as T-units. Speaker tags are discarded. 

4. Orthographic sentence fragments count as part of the T-unit to 
which they belong. 

5. True fragments resulting from the omission of a single word 
count as T-units with the missing word supplied. Other true 
fragments are discarded. 

6. Unintelligible word strings, vocatives, interjections, and various 
parenthetical or a-syntactic expressions found in conversational 
writing are discarded. 

7. Independent clauses differing from preceding clauses only in 
their subject, and thus elliptical beyond their verb auxiliary, are 
discarded. 

The steps to determine the average number of words per T-unit are: 
(1) count the total words in the sample, (2) count the number of T-units 
in the sample, and (3) divide the number of words by the number of T- 
units. 



Average number of words _ Number of words in sample 
per T-unit *~ Number of T-units in sample 



Teacher-researchers who do frequency studies must keep a record of 
the decision rules that govern counts and the reasons for the rules. 
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Counting in language studies is always harder than it seems at first, Mel- 
lon counted compound nouns written solid as one word, and counted as 
two words compound nouns written separately and hyphenated word 
pairs. He also counted as one word phrasal proper names (e.g., the 
Bronx Bomber), dates, and aphorisms from composition topics. 

Hunt reports the following patterns of T-unit length (average num- 
ber of words in a T-u nit): 8.6 in grade 4, 11. .5 in grade 8, and 13 in grade 
12 (Hunt 1965, 22). Rubin and Piche (1979, 303) report 8.86 (grade 4), 
11.59 (grade 8), and 14.15 (grade 12). Crowhurst (1980, 225) reports the 
following variation of T-unit length by grade level and mode: 

Grade i) Narration 10.60 Aigiimeru 13.79 
Grade 10 Narration 12.48 Argument 15.17 
Grade 12 Narration 12.51 Argument 16.06 

Loban (1976, 27) reports the following number of words per com- 
munication unit (same as I'-unit) for high, random, and low groups: 





High 


Grade 3: 


7.68 


(irade 4: 


8.83 


(irade 5: 


9.52 


(irade 6: 


10.23 


(irade 7: 


10.83 


Grade 8: 


11.24 


Grade 9: 


11.09 


(;rade 10: 


12.59 


(irade 1 1 : 


11.82 


(;rade 12: 


14.06 



Loban (1976, 25-26) comments. 



Random 


Low 


7.60 


5.65 


8.02 


6.01 


8.76 


6.29 


9.04 


6.91 


8.94 


7.52 


10.37 


9.49 


10.05 


8.78 


11.79 


11.03 


10.69 


11.21 


13.27 


11.24 



A high average number of words per communication unit could 
simply be the result of verbosity — an increased use of language 
without any significant increase in meaningful communication. In 
this research, however, this has not proved to be the case. Almost 
without exception, a high average number of words per unit is 
accompanied by a high teacher's rating on language skill, by a 
more effective use of phrases and clauses, and by the increased 
use of other forms of elaboration contributing to clear and mean- 
ingful communication. For this reason, the average number of 
words per communication unit has proved to be one of the most 
crucial measures of fluency developed during the course of this 
investigation. 
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Ratio of Clauses to T-units 

Length of T-unit indicates some things about the complexity of student 
writing at the sentence level, but it does not indicate whether that com- 
plexity involves an increased use of subordination. As one indicator of 
subordination at the sentence level, Hunt suggests the ratio of clauses to 
T-units: "Not only is the ratio of clauses to T-units a convenient arith- 
metical bridge, but it also provides by direct inspection an indication of 
how frequently a subordinate clause was added to a main clause" (Hunt 
1965, 35). This ratio indicates subordination through clause-embed- 
ding transformations by dividing the number of all clauses by the num- 
ber of main clauses or T-units. 



Ratio of clauses All clauses (subordinate -I- main clauses) 

to T-units Main clauses 



Hunt reports the following patterns of the ratio of clauses to T-units: 
averages were 1.30 in grade 4, 1.42 in grade 8, and 1.68 in grade 12 
(Hunt 1965, 35). Rubin and Piche (1979, 303) report 1.58 for grade 4, 
1.51 for grade 8, 1.64 for grade 12, and 1.61 for adults. Teacher-research- 
ers can use these findings as an indicator either of group deviation from 
the norm reported by other researchers or of problems in the design of 
the study, leading to skewed results. 

Noun and Adjective Embedding 

On the theoretical grounds that different embeddings require different 
skills, different types of consolidations and embeddings can also be 
counted. Hunt counted the different types of words used lo introduce 
various types of clauses: nouns (that, how, why), adverbs (if, while, until), 
and adjectives (who, whom, which). He found "no statistically significant 
increase in adverbial clauses, from grade to grade, though the increase 
in noun clauses and adjective clauses is statistically significant" (Hunt 
1965, 80) 



Hunt ( 1965), Loban ( 1976), and others have used different ways of re- 
porting the use of different clauses. Therefore, there is no general 
standard that can be reported. Mellon reports some interesting ideas, 
however, on the use of nominalism as an indicator of conceptual clevel- 



Noun and 
adjective 
embedding 
index 



Subordinators for noun clauses (that, how, why) 
or adjective clauses (who, which, that) 



Total words 
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opment in student writing. He was interested in trying to distinguish be- 
tween conceptual networking and syntactic manipulations. In his study, 
Mellon counts as nominal clauses the factive and interrogative clauses 
occurring in nominal positions, including appositive clauses (''The fact 
that it rained amused him"), and the WH + ever clauses C'He did what- 
ever she asked"). Mellon did not count adjective complements (''He was 
glad that she was sad") and fact-like comparative clauses ("It was so cold 
that his feet froze") as nominals on the grounds that these noun clauses 
were not naming concepts in the same way that factive and interrogative 
clauses were. 

The total number of clauses counted was then divided by total T- 
units. Mellon's experimental group, which practiced sentence-combin- 
ing problems, showed an increase of 14.35 to 17.76 (index multiplied by 
100), whereas the control group, which did exercises in traditional gram- 
mar and usage texts, showed a drop in nominal-clause usage (Mellon 
1969, 52). 

Mellon also counted noun phrases. A verbal, in order to count as a 
noun phrase, had to retain at least one constituent "from its deep struc- 
ture" (Mellon 1969, 46). "The man's arrival" and "the settlement of the 
case" counted, but "the arrival" and "the settlement" did not. Neither 
did adjective complements ("He was anxious to please her"), infinitival 
predicate complements ("He forced her to leave"), and catenated verb 
phrases ("He tried to fry the rice"). "He tried frying the rice" did count, 
as did other gerund, mfinitive, and derived -noun phrases occurring in 
nominal positions ("He left without saying a word"). 

These nominal phrases were counted and then divided by the total 
number of T-units. Mellon's experimental group showed an increase in 
the nominal phrase index from 5.86 to 9.74 (index multiplied by 100), 
and the control group showed a drop (Mellon 1969, 52). Mellon con- 
cluded in a later review, "Only the increase of restrictive embeddedness 
in dominant NP's deserves to be labeled growth" (Mellon 1979, 28). His 
point is that it is the child's gi owing network of conceptual knowledge 
that is responsible for the greater complexity of nouns and their restric- 
tive modifiers, not sentence combining. Sentence combining provides as- 
sistance in putting together the growing network of concepts, but, 
according to Mellon, does not itself generate the greater complexity of 
ideas. In other words, Mellon is claiming that sentence combining is ef- 
fective only if combined with wide reading and/or exploration of ideas. 

One approach to indexing the dominant NP is to count the average 
number of words in subject phrases, counting the subject words them- 
selves, only the subject modifiers before the subject, and only the restric- 
tive modifiers after the subject. The long string of prepositional phrases 
after the subject may present a conceptual difficulty. Are those phrases 
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conceptual networking or loose associations? The general rule is to 
count only the first prepositional phrase after the subject, all words in 
restrictive adjective clauses (who, which, that), all words in restrictive in- 
finitive phrases after the subject, and all words in restrictive participial 
phrases, both past and present. 



Dominant NP Modlkvs + subject nominal 

conceptual mdex ^ + restrictive modifiers 

(words per — — t. ^ — 

subject NP) '"^J^" nom.nals 



The following sentences are an example of such a count: 

L The man who ow is the car is here, = 6 

2. Myfriendy who owns the car, is here, = 2 

3. The captain, holding the wheel in his hand, died, = 2 

4. The man's arrival from the Smith Seas \-^?is uncxpGCtGd. = 7 

The theoretical foundation for counts of dominant NPs is uncertain 
at best. As Mellon has indicated, ^'Research on growth of restrictive 
dominant NP structure is needed" (Mellon 1979, 28). At this point, 
counting the number of words in NPs in the subject position appears to 
be one way of indexing the fact that mature writers see and say much 
more in fewer sentences and, to paraphrase Mellon, are required by 
their maturing conceptual knowledge to make additional restrictive, 
secondary statements in each independent clause (Mellon 1979, 18). 



2 Feature: Clear and Direct Sentences 

Theory: Case Grammar and Stylistics 

One of the principles of early transformational grammar was that if two 
surface structures derive from exactly the same deep structure and if 
their derivations differ only in the fact that an optional transformation 
has been applied to one and not the other, then the two surface struc- 
tures must have the same meaning (Katz and Postal 1964). By this mean- 
ing-preserving principle, the two sentences "Many people read few 
books" and "Few books are read by many people" must mean the same 
thing because the only difference between the two sentences is the op- 
tional passive transformation in the last sentence. 

But the two sentences do not mean the same thing, necessarily The 
first means that many people read very little, and the second means that 
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only a few books are really popular The point is that the movement of 
the actor or agent "people" from the front of the sentence to the end, an 
optional passive transformation, can change meaning. Sometimes the 
change is more subtle than the movement of the agent to the end of the 
sentence. For example, "The key opened the door" seems to have an ac- 
tive agent and an active verb ("The key opened"), but, in fact, the agent 
or person who actually opened the door is not to be found in the 
sentence. 

Transformational grammar did not explain these variations in mean- 
ing very well because it insisted on separating and isolating syntax and 
meaning, Charles Fillmore's case grammar (1968) was one effort to es- 
tablish the relationship between syntax and categories of meaning. In 
case grammar, noun phrases, in addition to their functions based on po- 
sition in the sentence (subject, object, and so forth), have various seman- 
tic functions or cases: 

L Agent: Bill in "Bill opened the door" and "The door was opened 
by Bill" 

2. Instrument: Key in "The key opened the door" and "The door was 
opened by the key" 

3. Experiencer: Bill in "Bill is sick" and "Bill has a key" 

4. Goal: Bill in "He gave the reward to Bill" and key in "Bill made the 
key" 

5. Loc^ tion: Here in "Bill was here" 

6. Objective: Door in "The key opened the door" and reivard in "He 
gave the reward to Bill" 

This kind of analysis enables one to talk about how three quite dif- 
ferent sentences are the same. In "I like books," "The books please me," 
and 'The books are pleasing to me," / has the same case o[ expenmcen 
but different sentence positions. This analysis also provides for a way of 
talking about directness and clarity of style. Says Joseph Williams, 
"Since subjects and agents tend to coincide in the vast number of lan- 
guages in the world, we might assume that their nexus is one of the 'nat- 
ural ways' that reinforce what a sentence is about to express" (1979, 602). 
Williams then argues that the clearest style is one in which the agent and 
what it does are signaled by at least three grammatical structures — the 
grammatically defined roles of subject and predicate, the sequence of 
subject-agent first and what it does second, and the form classes of noun 
for subject-agent and verb for what the agent does. 

Williams argues that "we need a theory of sentences in which clarity 
would be a concept we could not escape addressing" (32). He suggests 
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that in the study of sentences we should begin with the case grammar 
and then examine how the case grammar or semantic structure matches 
the syntactic gi'amman To WiUiams, clear sentences are those in which 
the case grammar agent is the syntactic grammar subject, the case 
grammar objective is the grammatical object, and so forth: "In short, 
the clearest style is one in which the grammatical structures of a sen- 
tence most redundantly support the perceived semantic structure," Wil- 
liams (1979, 601) gives the example below (fig, 7) of match and 
mismatch between case grammar and syntactic grammar 

Williams's views about style are compatible with those of E, D. 
Hirsch, Jr., who argties that there are universal stylistic features in all 
good prose and that these features of good style are redticible to a single 
principle: "One prose style is better than another when it communicates 
the same meaning as the other but requires less effort from the reader" 
(Hirsch 1977, 9). He calls this principle "communicative efficiency" and 
"relative readability" 

W^hat is readable? Because experiments have shown that clauses in 
English are more directly perceived than their constituent words (Bever 
1970), thus establishing the clause as the "primary perceptual unit" 
(Bever 1972), and because of the limits of short-term memory in storing 
units of information (Miller 1956), Hirsch argues that the crucial con- 
cept in readability is the concept of clause closure. Closure enables the 
reader to chunk the words into the single unit of the clause and to hold 
the structure in memory while reviewing meaning, lluis "That he had 
fallen into the pool was known by the whole class" is harder to read than 
"The whole class knew that he had fallen into the pool" because, accord- 
ing to Hirsch's theory of clarity, the second sentence gives us the clause 
structure at the very beginning ("The whole class knew that"), whereas 
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Figure 7, Match and mismatch between case grammar and syntactic grammar 
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the first sentence postpones closure on the clause structure until the 
very end, requiring the reader to hold more individual pieces in short- 
term memory. Williams would say that the second sentence is clearer be- 
cause the syntactic subject ("class") is the same as the case grammar 
agent. 

Although the clause is recognized as the primary unit in most theo- 
ries of clarity, the phrase is also recognized as a critical unit for chunk- 
ing. Consider, for instance, which of the following is easier to recall 
immediately: 

a. A leftward jaggedly descending curve 

b. A jagged broken curve descending leftward 

Various experiments suggest that the second one is easier to recall be- 
cause the reader uses the subject "curve" to chunk words into units, 
'jagged broken curve" and "descending leftward.*' In a, the postpone- 
ment of "curve" until the end prevents chunking into two units, and 
therefore short-term memory begins to get overloaded with four units, 
the four words before "curve." (If terms like short-term memory are un- 
familiar, return to this section after reading chapter 3.) 

But that is not the whole story. Rommetveit found that when subjects 
were given phrase a or b and asked to identify a picture of the curved 
line described in the phrase, subjects responding to a were more accu- 
rate than those responding to b (Rommetveit 1968, 287-300). Hirsch ar- 
gues that these experiments suggest that language which is easy to 
process, such as the language in phrase 6, does not necessarily do an 
accurate enough job of integrating material into a cohesive unit (Hirsch 
1977, 115-16). Says Hirsch, "Again, we are led to the view that good sty- 
listic choices are based upon intelligent compromises between conflict- 
ing psychological factors" (116) — readability or clarity, on the one hand, 
and an accurate integration of meaning, on the other Although these 
various theories of clarity have given us some useful ways of thinking 
about language, they have not solved the problem that the application of 
many maxims of clarity do, in fact, change meaning. 

Richard A. Lanham is one of those who has struggled with this prob- 
lem. In his book on revision, he says (1979, viii): 

But when do you want to cure it? Students today often feel — 
sometimes with justification — that they will be penalized for writing 
plain English. In the academic bureaucracy, writing plain English 
seems like walking down the hall with nothing on. Such public 
places demand protective coloration. Furthermore, if you are going 
to write in The Official Style, how do you make sure you are writing 
a good and not a bad one? And if The Official Style is, all said and 
done, a bad prose style — and it is — what, then, can "good" and 
"bad" mean when applied to prose? 
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Revising Prose starts out by teaching revision. Wlien you've 
learned how to do that, we'll reflect on what such revision is likely to 
do for you — and to you — in the bureaucratic world of the future. We 
ought then to be able to see what "good" and "bad" mean for prose, 
and what you are really doing when you revise. 

In his book on style, Lanham makes the following observation about 
an example of obscurity (1974, 29-30): 

Taken in the abstract, in a stylistic universe of grace and ele- 
gance, such utterance makes a lover of prose long to slide into a 
warm bath and open a vein. For it is vintage bureaucratese. Yet, in 
context, it becomes both comprehensible and, in today's world of 
hokum, inevitable. The university this president directs had just 
learned of massive budget cuts — cuts, furthermore, coming for a 
second successive year after several lean years. . . . 

If you are telling a man he is going to take a cut in salar)^ that 
hard times are here again, you had better be long-winded, dismal, 
above all formal. That shows (1) that you see the gravity of the situ- 
ation, (2) that yoLi feel the gravity of the situation as he does, (3) that 
you are the kind of sober and reliable fellow who can deal ivitli the 
situation. 

Lesson: Sentence Clarity 

Among the important lessons in the language arts classroom are those 
requiring students to rewrite hard-to-read sentences as more readable 
ones. The following sentences from Ross Winterowd's Contemporary 
Writer (1981, 461-62) are examples of the exercise and the rewrite: 

Whatever the family couldn't buy at the country store located at the 

crossroads five miles from town they did without, 

(The family did without whatever they couldn't buy at the country 

store located at the crossroads five miles from town.) 

The program was a concert of relatively pleasant newly discovered 

Appalachian dulcimer music. 

(The program was a concert of relatively pleasant dulcimer music 
that had been newly discovered in Appalachia.) 
lb bake potatoes on an open bonfire, as we did when we were kids, 
was always a great adventure, 

(It was always a great adventure to bake potatoes on an open bonhre, 
as we did when we were kids.) 

Joseph Williams is also concerned with how sentences end, arguing 
that in exposition, at least, clear sentences tend to end with coordinate 
structures, a nominalization, or a prepositional phrase introduced by of. 
Lessons on structure often use contrasung pairs and ask students to &t - 
lect the better sentence in each pair and to explain their selections. Wil- 
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Hams, for example, presents the following three pairs (1979, 607) to 
demonstrate the effect of the ending of the sentence. The lesson re- 
quires that the student identify in each pair which sentence is the orig- 
inal from W Somerset Maugham, and which is the undesirable rewrite: 

I have tiever had much patience with the writers who claim from the 

reader an effort to understand their meaning, 

I have never had much patience with the writers who claim from the 

reader an effort to understand what they mean. 

Few people have written English with more grace than Berkeley 

Few people have written English more gracefully than Berkeley 

You would have thought that men who passed their lives in the study 

of the great masters of literature would be sufficiently sensitive to 

the beauty of language to write if not beautifully at least with 

perspecuity. 

You would have thought that men who passed their lives in the study 
of the great masters of literature would be sufficiently sensitive to 
the beauty of language t( write if not beautifully at least 
perspicuously. 

Topic and Test Conditions 

A focus on clarity appears to require expository topics because passives 
tend to occur more frequently in expository prose, Williams says that 
narrative sentences do not show the same patterns in sentence endings. 
School assessors, therefore, should recognize that students who score 
well on narrauves may still score poorly on exposition, because as the 
topic's demands become more complex students tend to backslide into 
problems they had previously solved. Many researchers believe that nar- 
rauves based on personal experience do not require young writers to de- 
center, move away from an exclusive concern with themselves, that is, as 
much as does exposiuon based on society's problems and history, and 
thus demand less complexity 

Coding of Features 

There are two indexes for agent-subject sentences. One is the percentage 
of clauses having an agent-subject match. In the three pairs below, the 
first sentence has the match, and the second does not: 

/ saw the movie JT he movie was seen by me. 

The stars signaled the endJThe stars weir sign of the end. 

He discovered the secret in the book/The book revealed the secret to him. 
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Active sentence 

index Clauses with agent-sul)Ject match 

(% of clauses with *~ All clauses 

agent-subject match) 

The other index of clarity and directness, according to Williams 
(1979, 607), is the frequency with which sentences end with (1) a coor- 
dinate structure, either within the last phrase or as the last phrase, (2) 
a nominalization (a noun derived from a verb or adjective, including 
gerunds), or (3) a prepositional phrase introduced by oJ\ Says Williams, 
"Sentences tiiat are both clear and strong are predominandy agent-ac- 
tion sentences, sentences that move briskly through relatively short sub- 
jects and verbs into a comment that climaxes with one of those three 
structures. (Narrative sentences do not reflect these distributions.)'* 
(1979,607) 



Ending index Number of 

(% of sentences with = ^peof ending (coord/nom/prep) 
active ending) Total number of sentences 



Patterns of Use 

The active sentence index for one ninth-grade reading was .92. Williams 
reports that clauses written in an emphatic and confident style end 
about two dmes out of every three with one of the three structure above 
(1979, 607). The counts below come from Williams's analysis of an ar- 
ticle by Lee Eds on ("The Advent of the Laser Age," Nexv York Times Mag- 
azine, 26 March 1978, 34): 

Some sub-totals: the number of sentences in Edsoii's article that 



end in comments with 






«/•• 


22 


15.67f 


nominalizations: 


22 


15.67f 


coordination: 


17 


12.17f 


of -f nomin.: 


14 


9.97f 


of -f coord.: 


5 


3.57r 


nomin. 4- coord.: 


7 


57c 


all three: 


12 


8.5% 


none: 


43 


29.8^? 


total of: 


53 




total nomin.: 


55 




total coord.: 


41 





> 7().27f 
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Suggested Studies in Syntax 

1. If longer NPs in the subject position suggest an increase in con- 
ceptual complexity, then do students with longer NPs read more? 
Beth Wiley, a teacher-researcher in the Bay Area Writing Project's 
credential program, examined a version of this question in a re- 
sejirch project. She selected some writing samples for ranking the 
writing of the students in her class and then compared the general 
ranking of students as writers with the ranking of students on a 
norm-referenced language test (Wiley 1983). She found some in- 
teresting variations among the students, some students scoring low 
on the language test but high on the writing samples. 

2. If students rank essays, do they give high scores to essays with 
high clarity indexes? The issue is whether students have adopted 
in their reading the standards of clarity suggested by Hirsch. 
Hirsch seems to believe that the easier something is to read, the 
better Do young readers think so? 
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Bonnie Meyer (1982) has identified three levels of discourse organiza- 
tion: (1) the highlighting function (which helps a writer show a reader 
how some ideas are of greater importance than others); (2) the topical 
function (which helps both writer and reader conceive and organize 
main ideas on a topic); and (3) the informing function (which helps 
writer and reader make the transition from old to new information). In 
this chapter, the highlighting function is examined within the theory of 
the Christensens, the topical function is examined within various ap- 
proaches to cohesive ties, and the informing function is examined 
within different global scales of text structure. 

1 Feature: Highlighting Structures in the Text 

Theoiy: Christemen Sequences 

The work of Francis Christensen and Bonniejean Christensen (1978) on 
paragraph organization is an example of research focusing on high- 
lighting functions. The Christensens argue that paragraphs are similar 
to what they call cumulative sentences in that paragraphs have, among 
other things, something like a base clause and levels of generality The 
topic sentence is comparable to the base clause of a cumulative sentence 
because it is the structure to which all other sentences in the paragraph 
are added. The topic sentence is nearly always the first sentence of the 
paragraph. However, sometimes paragraphs do not have topic sentences, 
such as the following (Christensen and Christensen 1978, 93-94): . 

Paragraph without Topic Sentence 

2 In Spain, where I saw him last, he looked profoundly Spanish. 
3 He might have passed for one of those confidential street 
dealers who earn their living selling spurious Parker pens 
in the cafes of Malaga or Valencia. 
4 Like them, he wore a faded chalk-striped shirt, a coat 
slung over hi.s shoulders, a trim, dark moustache, and a 
sleazy, fat-cat smile. 
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4 His walk, like theirs, was a raffish saiiiUer, and everything 
about him seemed slept in, especially his hair, a nest of 
small, wet serpents. 
3 Had he been in Seville and his clothes been more formaU'he 
could have been mistaken for a pampered elder son idling 
away a legacy in dribs and on drabs, the sort you see in 
windows along the Sierpes, apparently stuffed. 
2 In Italy he looks Italian; in Greece, Cjreek: wherever he travels 
on the Mediterranean coast, Tennessee Williams takes on a 
protective colouring which melts him into his background, 
like a lizard on a rock. 
2 In New York or London he seems out of place, and is best ex- 
plained away as a retired bandit. 
3 Or a beach comber: shave the beard off any of the self-por- 
traits Gauguin painted in Tahiti, soften the features a little, 
and you have a sleepy outcast face that might well be 
Tennessee's. 

Kenneth Tynan, Ciirtabis, p. 266 

There are readers who think that the clause beginning with "wher- 
ever he travels" could be the topic sentence. The Christensens, however, 
want topic sentences at the beginning because for them topic sentences 
are little more than the beginning of a sequence of levels of generality. 
In the paragraph above, the levels of generality are shown by the num- 
bers—the 2s referring to or modifying the I, a 3 modifying a 2, and so 
forth. For example, the sentences that begin "In Spain," "In Italy," and 
"In New York" are on the same level of generality, and all have the same 
number — 2. The fact that they all have 2s means that these sentences in 
the paragraph are coordinate with each other. There are two basic se- 
quences of sentences — coordinate and subordinate (Christensen and 
Christensen 1978, 85, 82): 

A. Coordinate Sequence 

I He [the native speaker] may, of course, speak a form of English 
that marks him as coming from a rural or an unread group. 
2 But if he doesn't mind being so marked, there's no reason 
why he should change. 
3 Samuel Johnson kept a Staffordshire burr in his speech all 
his life. 

3 In Burns's mouth the despised Lowland Scots dialect 
served just as well as the "correct" English spoken by ten 
million of his southern contemporaries. 
3 Lincoln's vocabulary and his way of pronouncing certam 
words were sneered at by many better educated people 
at the time, but he seemed to be able to use the English 
language as effectively as his critics. 

Bergen Evans, Comfortable Words, 
p. 6 
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B. Subordinate Sequence Paragraph 

I The process of learning is essential to our lives. 
2 All higher animals seek it deliberately. 

3 They are inquisitive and they experiment. 

4 An experiment is a sort of harmless trial run of some 
action which we shall have to make in the real world; 
and this, whether it is made in the laboratory by sci- 
entists or by fox-cubs outside their earth, 
5 The scientist experiments and the cub plays; both 
are learning to correct their errors of judgment 
in a setting in which errors are not fatal, 
{5 Perhaps this is what gives them both their air of 
happiness and freedom in these activities. 

The first paragraph is called coordinate because most of the sentences 
are at the same level of generality (all 3s) v^ithout any intervening sub- 
ordinate sentences. The second paragraph is called subordinate because 
all of its sentences are at different levels of generality. From sentence 2 
on, each sentence is subordinate to the previous one. Notice that sen- 
tences with the same number or level of generality have similar struc- 
tures. According to the Christensens, 

Repetition of structure is necessary; like things in like ways is one of 
the imperatives of discursive writing. Any attempt to introduce va- 
riety in the sentence beginnings, by varying the pattern or by put- 
ting something before the subject, would be like trying to vary the 
columns of the Parthenon. In a subordinate sequence, just as 
clearly, repetition of structure must be avoided. Each added sen- 
tence, being different in method of development, must be different 
in form. (1978/84) 

The coordinate and subordinate sequences combine to produce the 
most common paragraph, the mixed sequence: 

C, Mixed Sequence — Based on Coordinate Sequence 
I An obvious classification of meaning is that based on scope, 
I This is to say, meaning may be generalized (extended, widened) 
or it may be specialized (restricted, narrowed), 
2 When we increase the scope of a word, we reduce the elements 
of its contents, 

3 For instance tail (from OE taegl) in earlier times seems to 
have meant 'hairy caudal appendage, as of a horse.' 
4 When we eliminated the hairiness (or the horsiness) 
from the meaning, we increased its scope, so that in 
Modern English the word means simply 'caudal 
appendage,' 

4 The same thing has happened to Danish hale, earlier 
'tail of a cow.' 
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5 In course of time the cow was eliminated, and in 
present-day Danish the word means simply *tail,' 
having undergone a semantic generalization pre- 
cisely like that of the English word cited; 
4 the closely related Icelandic hali still keeps the cow in 
the picture. 

3 Similarly, a mill was earlier a place for making things by the 
process of grinding, that is, for making meal, . . . 

D. Mixed Sequence — Based on Subordinate Sequence 

I Science as we know it indeed is a creation of the last three 
hundred years. 

2 It has been made in and by the world that took its settled 
shape about 1660, when Europe at last shook off the long 
nightmare of religious wars and settled into a life of in- 
quisitive trade and industry. 
Science is embodied in those new societies; 
it has been made by them and has helped to make them. 
4 The medieval world was piissive and symbolic; it saw in 

the forms of nature the signatures of the Oeator. 
4 From the first stirrings of science among the Italian 
merchant adventurers of the Renaissance, the mod- 
ern world has been an active machine. 
5 That world became the everyday world of trade in 
the seventeenth cetHury and 
the interests were appropriately astronomy and the 
instruments of N-oyage, among them the magnet. 
5 A liundred years later, at toe Industrial Revolution, 
the interest shifted to the creation and use of 
power. 

6 This drive to extend )rhe strength of man and 
what he can do m a clay's work has remained 
our interest since. 
7 In the last century it moved from steam to 
electricity. 

7 Then in 1905, in that wonderful year 
when ... he published papers which made 
outstanding advances in three different 
branches of physics, Einstein first wrote 
down the equations which suggested that 
matter and energy are interchangeable 
states. 

7 Fifty years later, we command a reservoir of 
power in matter almost as large as the sun, 
which we now realize manufactures its heat 
for us in just this way, by the ar^nihilation of 
its matter. 

(J. Bronowski, The Common Seiise of Science [Cambridge: Harvard 
Univ. Press, 1978], 97-98) 
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Lesson: Levels ofGmerality 

Traditional teaching approaches to discourse organization usually em- 
phasized the topical function (the thesis sentence), but the Christensens' 
new rhetoric shifted the emphasis from the topical function to highlight- 
ing. The Christensens, in fact, argued that the thesis sentence was 
simply the first sentence and that the relationship among the sen- 
tences — subordinate, coordinate, and mixed — was the key organiza- 
tional pattern in discourse, not what was first. Their approach 
generated a number of textbooks and teaching approaches still used in 
K— 12 classrooms. 

The lessons on levels of generality ask students to identi fy those levels 
in a given paragraph, to invent the sentences that might be written at dif- 
ferent levels of an assigned paragraph structure, and to extend the anal- 
ysis of levels of generality to whole essays, treating each paragraph as 
one level in a sequence. The work of James Gray and Robert Benson 
(1982) gives other examples. The following selection from a Benson les- 
son (35) illustrates what happens: 

In asking the students to build a subordinate sequence para- 
graph, 1 have them go back to the previous topic: "Why are you in 
college?" Earlier it had discouraged them, but this time they are 
aided by the visual image of a series of sentences connected by a se- 
quence of descending levels, each sentence leading on bgically to 
the next. "It s like going downstairs," I tell them, and the object in 
this exercise is to go down . as far as possible, to establish an tmbro- 
ken sequence of thought, to follow the route suggested by each sen- 
tence as it is written. 

Why am I here? 1 am here because I am really getting bored 
with the post office. 1 work in the mail sort room, and this means 
you spend all your time sorting and carrying mail. 1 have to carry 
50 pound sacks of mail and dump them onto a conveyor belt for 
two hours a day 1 don't mind hard work, but can't you imagine 
yourself after twenty years of abuse to your back? You would be 
next in line for the Quasimodo look-alike contest. I want out, and 
school is a good way to escape. If 1 get a degree, I might have a 
better chance of finding a job that doesn't require so much phys- 
ical exertion. I guess you could say I'm in school to save my ach- 
ing back, 

— Rafael (ionzales 

Topic and Test Conditions 

Some topics are thought to be more likely to generate particular se- 
quences. For example, in narradve topics, students often use many co- 
ordinate sequences arranged in chronological order— awrf, and then, and 
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so Forth. The best way to test what is likely to happen with a given topic 
is to have teachers and a selected group of students write on the topic 
and then apply a selected method of feature analysis. 

Coding of Levels of Generality 

The coding of levels of generality has two approaches. For many teach- 
ers, the encouragement of paragraph development, no matter what 
kind, is a central purpose of instruction, and for these teachers the av- 
erage number of sentences per paragraph and the nimiber of para- 
graphs are useful indicators of paragraph devek)pment. In this index, 
however, the sentences could be short and the overall organization 
confused. 



Paragraph Total number of sentences / Number of 

development - ^y^i^^l number of paragraphs ' paragraphs 
mdicator r o r 



Another indicator of paragraph development is the index of levels of 
generality. This index adds together the numbers marking the level of 
generality of each sentence and divides the total by the number of sen- 
tences in the paragraph, giving the average level of generality in the 
paragraph. If more than one paragraph is to be indexed, then the in- 
dexes for each paragraph are added together and divided by the num- 
ber of paragraphs. 



LG = Levels of generality for the paragraph 

LG index (average) ^ I^^L^i^ t2 iiuiTibersjn [)aragrap_h_ 
for paragraph Total sentences in paragraph 



LG = Levels of generality for the essay 

LG index (average) _ ^Ibtal of LG indexes for each paragraph 
for essay ~ Total number of paragraphs in essay 

For example, the LG Index for the coordinate paragraph a on page 44 
is calctilated as foHows: 

Total of LCi numbers in paragraph a: 1,2,3,3,3 = 12 
Divided by total number of sentences: LG Total: 12 



Divided by 5 sentences 
LG index for paragraph a: 12 divided by 5 sentences = 2,4 
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The LG index for an essay composed of pai'agraphs 6, r, and d is cal- 
culated as follows: 

LG index for b: 2i divided by 6 sentences = 3,5 
Lfi index for c: 20 divided by 7 sentences = 2.8 
LG iiirdex for d: 44 divided by 10 sentences = 4.4 
Tofal of LGs for each paragraph: 3.5 + 2,8 + 4,4 = 10,7 divided 
by 3 (number of paragraphs) = 3,5 

The approaches discussed thus far have had two means of judging 
paragraph development, length of the paragraph calculated in avei age 
number of sentences per paragraph, and average level of generality in 
the paragraph or essay. But counts are not the only way to study para- 
graph development. Counts provide one kind of description of para- 
graphs, but the counts themselves do not necessai ily mean anything. An 
average level of generality of 2, for example, representing very liule sub- 
ordinauon, is neither gcod nor bad in itself. More global considerations 
are at work when value judgments are made. Instead of counts, Rebekah 
Caplan, a teacher in the Bay Area Wridng Project, and Catherine 
Keech, a research assistant in the project, used a general impression 
scale to index coordinate and subordinate sequences or levels of gener- 
ality Their study, examining the effects of a wridng program empha- 
sizing the importance of concrete detail, coded sequences of abstract 
and concrete detail. In addition to holistically scoring the wridng 
samples, readers ranked each sentence in the student essays as (1) highly 
abstract, (2) more focused generalization, (3) somewhat generally stated 
detail or example offered, and (4) specific, concrete detail, iniage, or 
event. The range of movement among levels of abstraction was calcu- 
lated by subtracting the top (most abstract) level from the bottom (most 
concrete) level used by the student (e.g., 4-1=3). The two examples 
below show samples of student wridng from Caplan and Keech's study 
(1980, 129-31), their holistic scores for the wridng, the scales for the lev- 
els of abstracdon, the sentence analysis chart, and the commentary on 
each paper: 

Ibpic A — Holistic Score: 4 + 4-8 

(1) "(Jet off that box!" (2) A day doesn't go by that 1 don't hear 
those words. (3) "The Box" or "The idiot box" are the ways niy 
parents define the word television set. (4) The fighdng and ar- 
guing always starts because of my little brother who watches an 
overwhdmiiig amount of TV, at least four hours everyday (5) It 
is amazing how much time he has to waste watching everything 
that Hashes on the screen from "Hawaii five-0" to "Big 1 1me 
Wrestling" while I hardly find the time to watch one program per 
week. 
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({5) All those comercials and programs tliat clog his mind; also 
have a great deal of hilliience over him. (7) Programs such as 
'The vStreets ofSan Francisco" and "Starsky and Hutch" teach a 
child about violence, robbery, rape and many other crimes, 

(8) Many advertisements also are a bad inHuence, (9) The cig- 
garatte comericals teach that smoking is glaniorus and the junk 
food comericals, especially the cerials teach the younger minds 
that eating sugar coated pink and green shapes can be good for 
vou. 

(10) Conunercials like these can throw a child off as far as 
reality is concerend not to metion the eaquily bad influence of 
television programs. 

Ln^el oj Abstraction Analysis ^ 

Number of Different Abstraction Levels Used: Top Level -A^ 

Bottom Level 
'Ibtal Range ^ 

Sentence Number: 



1 2 3, 4. f) 6 7 8 9 U) II 12 13 14 15 10 17 18 19 20 21 22 
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This paper is interesting in two respects. First, it begins with a con- 
crete episode and direct quotations — Cjuite effcTtive in this case. 
Second, it never quite reaches level one, a full statement of the thesis 
the essay is arguing. Sentence ten comes closest to filling that func- 
tion. In spite of— or because of— this rather atypical approach to 
argument, the paper was scored as an upper-half paper. Sentence 
nine stands out for its use of details which make children's cereals 
sound poisonous without ever making that claim. 

Topic A — Holistic Score: 5 + 5 = 10 

( I ) I'he greatest thing about the United States is the free- 
dom offered here. (2) Everyone has freedom of choice. (3) 
Television is one example of freedom of choice. (4) No one is 
forced to watch a program or not to watch another. (5) Even 
though some television programs display violence or sex, it is 
the right of every citizen to decide what they want to see. (6) 
A program can not influence anyone unless they desire it to. 

(7) Many shows, for example. Kojak and Barretta, show its 
viewers violent street crime. (8) These could be considered an 
influence of how one is not supposed to act and not necessar- 
ily lead them on to copy these examples. (9) However, like most 
decisions in life, some will choose to follow the "wrong path". 
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(10) These people are only wrongly influenced because it was 
their choice, (11) no one forced them to sit in front of the tube 
at 8:30 and watch chanel whatever. 

(12) Critics complain frequently about the content of tele- 
vision programs. (13) They, however, seem not to take into 
Consideration the education offered in some such as Sesame 
Street and leens today. (14) From these, large numbers of 
children in the United States have undoubtedly benefited. 

(15) lelevision can be considered good or bad depending 
on which programs and what outlooks one takes. (16) Every- 
one is free to switch it off if diey feel a Hick not worthy. (17) 
lelevision 's influence only depencis on the individual. 

Lei*el of Abstraction Analysis 

Number of Different Abstraction Levels Used: Top Level -In 

Bottom Level Ai. 

Ibtal Range A 

Sentence Number: 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 1.5 16 17 18 19 20 21 22 
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This paper appeared difficult to analyze at first, because the intro- 
ductory sentences about "freedom of choice," if classified as level 
one, pushed all the following sentences down one level in compari- 
son with similar sentences in other student essays. Sentences three 
and four "Television is one example of freedom of choice. No one is 
forced to watch a program . . /' begin the discussion of television it- 
.self, which is where most other papers commence. Raters solved the 
problem by classifying sentences one and two as more abstract than 
the frame. As a result, although the student does not use level four 
sentences, he can be said to have a total range that crosses three 
level-boundaries. 

In this context, sentences four, six and sixteen say much the same 
thing. Sixteen is classified as slightly more concrete because of the 
qualifying clause, "if they feel a flick is not worthy." 

Patterns of Use 

Teacher-researchers who wish to compare their findings with the find- 
ings of others will find the norms in the area of paragraph development 
somewhat obscure. First, many studies do not present student examples 
to illustrate what is being discussed. Second, paragraph development 
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has not attracted as much research interest as has syntax. However, some 
patterns are available. One study of paragraph length in academic ar- 
ticles found a mean (average) of 5,0 sentences per paragraph, a standard 
deviation of L6, and a range from L7 to ILO (Broadhead, Berlin, and 
Broadhead 1982, 231). One ninth-grade readingshowd an average par- 
agraph length of 3.5 senten.es per paragraph for high papers and 1.3 
for km papers. The index of 1- ^Is of generality for these ninth-grade 
papers was 1.9 for high paper., .. id 1.2 for low papers, 

2 Feature: Cohesive Ties 

Theory: Cohesion 

The traditional view has been that the next unit above the sentence was 
the text and that the text could come in the form of one or more para- 
graphs, which L'.sually had two or more sentences each. The Clhristen- 
SGns theory of sequences represents one effort to describe inter- 
sentential relationships in terms of some definitive unit of analysis. 
Cohesion theory represents a second effort, Clohesion refers to "text- 
forming relations" (Halliday and Hasan 1976, 7), and its primary unit of 
analysis is the cohesive tie. 

W. Ross Winterowd has identified seven types of ties, each expressing 
a different relationship (Winterowd 1975, 229--30): 

Coordination can always be expressed by and. (Synonyms: furthir- 
more, in addition, too, also, again, etc.) 

Boswell was a Rousseau-ite, one of the Hrst of the Romantics, an 
inveterate sentimentalist, AND nothing could be more complete 
than the contrast between his career and Gibbon's. 

— Lytton Strachey 

They almost hid from us the front, but through the dust and 
the spaces between running legs we could see the soldiers in the 
trench leap their barricade like a breaking wave. AND then the 
impenetrable dust shut down AND the fierce stabbing needle of 
the machine guns sewed the mighty jumble of sounds together. 

— John Reed 

. . . Marat is, in most of his speeches, tinsel, stage scenery, or an 
element in a great painting, AGAIN, the Brechtian songs are 
touching, but ironically and allusively touching; Charlotte (k^r- 
day, th^ mad, beautiful country girl mouthing her lines, is 
AGAIN an element in a picture, an aesthetic contrivance. 

— Stuart Hampshire 

Ok'ersaiiviiy can always be expressed by but, (Synonyms: yet, hoic- 
ever, on the othei^ hand, etc.) 

It has been ambitious and plucky of me to attempt to describe 
what is indescribable, and I have failed, as I knew I would. BUT 
I have discharged my duty to society . . . — E. B. White 
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And Johnson, as Kennedy has often acknowledged, was a man of 
force and decision to whom, in case anything happened, the gov- 
ernment could responsibly be assigned. 

ON THE OTHER HAND, the designation of Johnson would 
outrage the liberal wing of the party. —Arthur Schlesingerjr 
Camalivity can always be expressed hy for It is interesting to note 
that among the transitional adverbs commonly used (nevertheless, 
however, moreover, hence, consequently, nonetheless, accordingly! 
then, besides, likewise, indeed, therefore), none expresses the caus- 
ative relationship. 

Now, on that morning, I stopped still in the middle of the block, 
FOR I'd caught out of the corner of my eye a tunnel-passage an 
overgrown courtyard. ^Tnman Capote 

Conclusivity can always be expressed by so. (Synonyms: therefore 
thus, for this reason, etc.) 

She has a rattling Corsican accent, likes Edith Piaf records, and 
gives me extra shrimp bits in my shrimp salad. SO some things 
change. Last time I heard no Edith Piaf and earned no extra 
forkfuls of shrimp. ^Herbert Gold 

Alternativity can always be expressed by or 
Now such an entity, even if it could be proved beyond dispute, 
would not be God: it would merely be a further piece of exis- 
tence, that might conceivably not have been there— Oi? a dem- 
onstration would not have been required. —John A. T. Robinson 
Inclusiviiy is often expressed with a colon. 

In the first century B.C., Lucretius wrote this description of the 
pageant of Cybele: 

Adorned with emblem and crown ... she is carried in awe-in- 
spiring state. . . . —Haruey Cox 
The inclusive relationship is that of the example to the generality or 
the narration of the case to the statement of the case. Often, inclu- 
sivity is expressed by the transformational possibility of 
complementization : 

He realized that their discovery [Aristotle's discovery of the stat- 
ues of Daedalus] would shatter his own "natural" law: Managers 
would no longer need subordinates, masters could dispense with 
^^'^^'^^'^^ — Michael Harrington 

With the last two clauses complementized, the sentence reads like 

this: 

He realized that their discovery would shatter his own "natural" 
law, that manager:, would no longer need subordinates, and that 
masters could dispense with slaves. 

The sequeyitial relaiioiuhip is expressed by such transitions as 
"first ... second ... third," "earlier. .. later," "on the bot- 
tom ... in the middle ... on top," and so on. 

Winterowd's list is not conclusive. In the system of M: A. K. Halliday 
and Ruqaiya Hasan (1976), there are five major types of cohesive ties— 
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substitution, ellipsis, reference, lexical, and conjunction — and many of 
Wintcrowd's transitions are examples conjmiction. Halliday and Has- 
an's conjunction comes in four forms (1976, 238-39): 

additive: and, or, besides 

For the whole day he climbed. And he met no one. 
adversative: but, yet, however, on the other hand, nevertheless 

Yet he was hardly aware of being tired. 
causal: so, because, if/then 

So by evening he had left his camp far below him. 
temporal: next, then, after, first, finally soon 

TImi he sat down to rest. 

The other four major types of cohesion also come in various forms. 
The most frequent type reference is the use of pronouns, and a com- 
mon oubsiitution is one ("Two men have just arrived. The first one you 
know"). Ellipsis is the dropping of words that are understood ("Metal 
stocks will not fall. Neither will electronics [fall]"). Finally, lexical cohe- 
sion is the use of synonyms and the repetition of words. 

Most ties have a dimension of directionality referring back fawa/?/iomj 
or forward (cataphora) in the text. This trait of forward and backward 
directionality is one indicator of stylistic variety in paragraph develop- 
ment. There is also the reference outside of the text (exopliora), such as 
Fillmore's famous example of the note in the bottle which washes up on 
shore: "Meet me here tomorrow with a stick about this big." These out- 
side references often have a deictic function, putting writer and reader 
in the same situational space. These dimensions will be discussed in 
more detail in the chapter on social context. 

In addition to directionality, Halliday and Hasan's cohesive ties have 
a text-span dimension with four different classes. Witte and Faigley 
(1981, 194-95) give the following description of how to classify a stu- 
dent's text span: 

Text-Span Clnsses (Immediaie, Mediated, Remote, Mediated-Remote) 

(31) Respect is one reason people change their behavior 

(32) For example, one does not speak with his 6055 as he would 
talk to a friend or co-worken 

(33) One might use four-letter words in talking to a co-worker, 
but probably not in talking to his ho.\s. 

(34) In talking to teachers or doctors, people also use bigger 
words than normal. 

(35) Although the situation is different than when one speaks 
with a boss or a doctor, one often talks with a minister or priest 
different [sic] than he talks with friends or family. 

(36) With the family, most people use a different language when 
they talk to parents or grandparents than when they talk to 
younger brothers and sisters. 



57 



Text 



55 



(37) People's ability to use language in different ways allows thein 
to show the respect they should toward (iifferent people, 
whether they are professionals, faviily members, clergy, 
friends and co-workers, or bossea. 

Immediate cohesive ties semantically linked adjacent T-units, The 
repetition of doctor in sentences (34) and (35) creates an immediate 
tie, forcing the reader to assimilate the content of (34) into the con- 
tent of (35). In contrast, the repetition of family in sentences (35), 
(36), and (37) forms a mediated tie. The semantic bridge established 
by the occurrence of family in (35) and (37) is channelled through 
or mediated by the repetition of family in (36). The cohesive tie in- 
volving the repetition of family is not simply a series of immediate 
ties, because once a lexical item appears in a text all subsequent uses 
of that item presuppose the first appearance. Immediate and me- 
diated ties join items in adjacent T- units. Such ties enable writers to 
introduce a concept in one T-unit and to extend, modify, or clarify 
that concept in subsecjuent and successive T-units. 

Remote ties, on the other hand, result when the two elements of a 
tie are separated by one or more intervening T-units. The tie be- 
tween respect in (31) and (37) is remote; here the repetition of the 
word signals to the reader that the semantic unit represented by the 
paragraph is now complete. Penally, tie,s which are both mediated 
and remote are called mediated-r emote. An example of this type of 
cohesive tie appears in the repetition of bosses in sentences (32), (33), 

(35) , and (37). Here the presupposing bosses in (37) is separated 
from the presupposed boss in (32) by intervening T-units (34) and 

(36) which contain no element relevant to the particular cohesive tie. 
Thus the tie is remote. However, the presupposing basses is also me- 
diated through repetitions of boss in (33) and (35). Hence the term 
mediated-remote , Skilled writers use mediated-remote ties to inter- 
weave key "themes" within the text. 

Theories of cohesive ties generally argue that ties can indicate a writ- 
er's linguistic resources for idea development. A number of reservations 
have been expressed, however, about the present state of cohesion the- 
ory. For example, some researchers have argued that Halliday and 
Hasan should have included parallelism as an indicator because paral- 
lelism often creates a cohesive tie, creating a relationship, as the Chris- 
tensens have said, by repeating structure (Witte and Faigley 1981, 200), 
A second argument says the ties are markers of cohesion, not its crea- 
tors. If there is not already some lexical compatibility, then the presence 
of a cohesion marker cannot establish a relationship. The question re- 
mains, therefore, what the source of cohesion actually is. One result of 
the debate over cohesion is the view that cohesion (and its ties) are not 
the same as coherence (Witte and Faigley 1981, 199). Cohesion refers to 
explicit mechanisms in the text — for example, cohesive ties, parallelism, 
verb tense — and coherence refers to conditions that allow a text to be 
understood in a real-world setting. Some of these conditions will be the 
subject of the next section. 
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Another criticism of present theory of cohesive ties is that most counts 
of ties and their classification ignore the location of each tie, Joseph Wil- 
liams, for one, has argued (1985) that the location of old and new infor- 
mation is a critical feature of text cohesion. In his view of the cohesive 
text, the sentence should typically begin with "old" information, that is, 
information introduced at the end of the previous sentence, and then 
move to new information. 

Lesson: Connecting Text 

Most composition books have lessons on transitions. One common ap- 
proach is to give students a rewritten paragraph in which some of the 
transition words have been changed to illogical and incorrect selections 
and ask the students to find the transitions that do not vvork. Ken Davis's 
use of the cloze test as a diagnostic tool for revision is another interesting 
way to teach awareness of cohesive ties and their function in the text 
(1982, 121), In this exercise each student prepares a cloze test by count- 
ing back fifty to one hundred words from the end of the essay. The point 
is that the test should begin after the first five to ten lines, depending on 
the total length of the essay. For younger children, a shorter beginning 
will be needed. Then in the section counted the student should under- 
line every fifth, seventh, or tenth word and recopy the essay, substituting 
numbered blanks for the underlined words. Finally, the student should 
prepare a chart like that below, which will accompany the recopied essay 
with its blanks. Then the chart and essay circulate among readers who 
must fill in the chart with guesses about what word is missing from the 
blank. Result: readers must k)ok for clues, often in the form of cohesive 
ties, about what the missing words might be. Writers have the readers' 
guesses returned to them, allowing them to calculate how predictable 
the text was. (See Davis's article for a good foHow-up discussion with 
examples.) 



Blank # 


Your word 


Reader I 


Reader 2 


Reader 3 


H or M 


+ or - 


1 














2 





























Joseph Williams presents another kind of lesson examining the co- 
hesiveness of texts. He begins with illustrations of his two principles of 
order and emphasis, defining the relationship of old and new informa- 
tion in a cohesive text: 
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Whenei'er possible, express at the beginning of a sentence ideas already 
stated, refened to, implied, safely assumed, familiar, predictable, less irn- 
portant, readily accessible information. 
The other principle is this: 

Express at the end of a sentence the least predictable, the most important, 
the most significant information, information you almost ceitainly loant 
to emphasize. 

Then he introduces several paragraphs which may violate these two 
principles and asks the student to revise where necessary. 

Topic and Test Conditions 

Teacher-researchers must remember, as always, that topic and test con- 
ditions can influence the use of cohesive ties, Bonnie Meyer's notion of 
five basic writing plans (Meyer 1982) suggests that some topics will, in 
fact, encourage the use of some kinds of transitions and discourage the 
use of others. Similarly, Stephanie Gray and Catherine Keech, teacher 
consultants in the Bay Area Writing Project, found that lessons empha- 
sizing comparison topics produced an increased use of -er adverbs 
(longer, faster, better) and such terms and phrases as whereas, on the other 
hand, and cls , . . as (1980). 

Coding of Features of Coherence 

One formula used as an index of ties is a count of the ties divided by the 
total number of words in a text. 



Markers of coherence by type 
(reference, substitution, etc.) 
Total words 



This index assumes that the frequency of ties is an indicator of the writ- 
er s improvement in understanding paragraph development. For some 
students in some classrooms, this assumption may be correct. Another 
formula used is a count of cohesive ties divided by the total number of 
T-units, the result multiplied by 100. The teacher-researcher, of course, 
must explain the basis for selecting whatever index is used. 



Tie /T-unit 

index Total number of cohesive ties (by type) 

(cohesive ties ~ Total number of T-units 

per 100 T-units) 



Cohesive ties 
index 
(ratio of cohesive 
ties to total words) 
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The index above assumes that the use of ties must not be restricted to 
connecting clauses (T-units), but must include connections within the 
clause. Another index is a count of the text-span classes described by 
Witte and Faigley. I have never tried this count in a school district as- 
sessment, but I have been told by teacher-researchers that it is useful. 



The various indexes of cohesive ties are not as clearcut as they at first 
seem. The coding of ellipsis and lexical ties, for example, can be very 
difficult for readers with little experience with the concept. Ellipsis 
needs to be given a very limited definition. Say Hal I id ay and Hasan, 
"When we talk of ellipsis, we are not referring to any and every instance 
in which there is some information that the speaker has to supply from 
his own evidence. . . . We are referring to sentences, clauses, etc., whose 
structure is such as to presuppose some preceding item, which then 
serves as the source of the missing information. An elliptical item is one 
which leaves specific structural slots to be filled from elsewhere" (1976, 



The problem is that some coders will say that the sentence "We left" 
is an example of ellipsis because a previous sentence makes clear what 
structural slot follows "left." That is, it was "the home" which was left, for 
example. This interpretation opens ellipsis to very diverse coding. 
Teachers who code ellipsis should list many examples on the coding 
sheet, showing"What counts and what does not. 

A restricted definition and extensive training are also needed to code 
lexical cohesion. Halliday and Hasan have oudined the difficulties in- 
volved, concluding that "the concept of the lexical item is not totally 
clearcut; like most linguistic categories, although clearly defined in the 
ideal, it presents many indeterminacies in application to actual in- 
stances" (1976, 292). A restricted definition of lexical cohesion, making 
more reliable coding possible, is: "Lexical cohesion includes instances of 
repeating the same word, synonyms (apple [or fruit, peak for top of the 
mountain), closely related pairs representing a contrast fw^^J^y, boys/girls) 
or sequence (joke/laugh, mominglaftemooni night) or parts of the same set 
(north/south, blup/ied, do or/ window).'' 

Patterns of Use 

Four examples of studies of coherence are presented here. In the 1980 
Gray and Keech study* students who were given extensive practice writ- 



Index of 
text-span types 



Total number of a given type of text span 
(immediate, mediated, remote, 
mediated-remote) 



Total of all types of text span 
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ing comparison essays increased their use oi as words (whereas, on the 
other handy however, as . , , as), as shown in the ratio of as words to total 
words— from ,0153 to .0233 in eleventh grade and from .0149 to ,0294 
in ninth grade (42), 

Second, in a study of the writing of college freshmen, Cooper et al, 
(1979) found that comparatives were more frequent in the writing of the 
best writers. They report that such expressions as same as, similar to, dif- 
ferent from, and better or worse than were not present in the writing of the 
weakest writers. The best writers, however, used approximately 10 such 
comparatives for every 100 T-units. Substitution and ellipsis did not ap- 
pear at all in papers by weak writers, and the best writers used substi- 
tution 2.90 times per 100 T-units and ellipsis 1.45 times. The use of 
conjunction per 100 T-units was 17.39 for the most competent and 16.36 
for the least competent. The most striking differences in lexical cohesion 
occurred in synonyms. The strongest writers used 11.59 synonyms per 
100 T-units, and the writing of the least competent writers had no ties 
whatsoever resulting from the use of synonyms. 

Third, in a study of tenth-grade writing. Ken Lane, Sandra Murphy, 
and Kathleen Berry (1981) found the following distribution of Halliday 
and Hasan's four types of conjunctions: 

Additive Causal Adver^sative Temporal 

49.80 11.27 15.57 23.36 

They also found that writers in the low-scoring group averaged 5.06 ad- 
ditive ties per 100 words, but writers in the middle range of scores av- 
eraged 3.80 and writers in the high group averaged 3.36 addidve ties 
per 100 words. 

On text span and other indexes, Witte and Faigley report the follow- 
ing results from an analysis of ten essays written by college freshmen 
(1981, 196): 

The ways in which writers of the high- and low-rated essays form 
cohesive ties also distinguish the two groups of five essays from each 
other Writers of the high-rated essays use a substantially higher rel- 
ative percentage of hmnediate (High: 41.6%/Low: 32.8%) and me- 
diated (High: 7.6%/Low: 0.8%) cohesive ties than do the writers of 
the low-rated essays. On the other hand, writers of the low-rated es- 
says use more viediaied-reinole {High: 2.5.9%/Low: 36.7%) and remote 
ties (High: 26.9%/Low: 29.7%). These percentages allow us to focus 
on some crucial differences between the two essay sets. The larger 
relative percentage of imviediate cohesive ties in the high-rated es- 
says suggests, among other things, that the better writers tend to es- 
tablish stronger cohesive bonds between individual T-units than do 
the writers of the low-rated essays. Analyses of reference and con- 
junctive cohesion support this observation. Writers of high-rated es- 
says employ reference cohesion about twice as often, 84.1 times to 
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478 times per 100 T-units, as the writers of low-rated papers. The 
largest clifference in the occurrence of referential cohesion is re- 
flected in the higher frequency of third-person p' onouns in the 
high-rated essays (High: 25.1 per 100 T-units/Low. 5,1 per 100 T- 
units). This lower frequency of third-person prorouns in the low- 
rated essays may be a direct result of the less skilled writers' at- 
tempts to avoid errors such as ambiguous pronoui, refeience. Be- 
cause third-person pronouns usually refer back i'> the T-unit 
immediately preceding, we can infer that the writers of high-rated 
essays more often elaborate, in subsequent and adjacent T-units, 
topics introduced in a given T-unit, 

They also add to their report the following kind of descriptive ap- 
proach to cohesion (a comment on a high-rated paper): 

It is a job that really changes our behavior. Among other 
changes, we change the way we dress. In many jobs college grad- 
uates want to look responsible and mature, projecting an image 
of competence. The college student who wore faded blue jeans is 
now in three-piece suits. He feels the need to be approved of and 
accepted by his boss and associates. While he talked of socialism 
in college, he now reaps the profits of capitalism. While in college 
he demanded honesty in the w^ords and actions of others, on the 
job he is willing to ''kiss ass" to make friends or get a promotion. 
Indeed, working can change behavior. 
Notice that in the paragraph [above] from the high-rated paper, be- 
havior is repeated only one time. Yet the reader never questions that 
the paragraph is about changes in behavior. The writer repeatedly 
supplies examples of types of behavior, which are linked to the topic 
by a series of lexical collocations (e,g,, behavior, dre,ss, look responsible, 
blue jeans, three-piece suits). Clearly, the paragraph from the high- 
rated paper extends the semantic domain of the concept behavior to 
include a number of differentiated lexical items. Low-rated papers 
rarely show such extended series of collocations, 

3 Feature: Global Impressions of Text 

Theoij: Organizational Structure and Analytical Scoring 

A number of scholars have serious reservations about the use of counts 
to describe the structures of texts. These scholars argue first that some 
sentences have relationships unmarked by a given cohesive tie. For in- 
stance, the two sentences "He wanted to win the prize. He did not get it." 
have between them an unstated ''but." In this case, a count would not 
reveal structure. 

A second argument is that the structure of a text is often defined by 
a relationship among several structures, not just the matching of one. 
The mind helps locate the meaning in the text, inserting such things as 
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the "but," by making various guesses about the relationships among sev- 
eral overall structures that are used as guides but that rarely appear in 
pure form in actual texts. For example, Bonnie Meyer's five basic writing 
plans — antecedent/consequent, comparison, description, response, and 
time-order — sometimes appear in combination with one another One 
plan may be primary but other plans also appear 

In addition, the question of what is basic is itself an estimate of prior- 
ities, Frank J. D'Angelo (1975), for example, seems to use a sense of 
movement as the categorical principle, dividing structure into (I) static, 
(2) progressive, (3) repetitive, and (4) nonlogical. The static structures 
are description and classification; the progressive structures are nar- 
rati ,n, process, and cause-effect; and the repetitive structures are the 
enumeration or listing of items and the movement between negative and 
positive assertions. Josephine Miles (1979) has a different list of patterns 
of organization, J^i^ *ng priority to the parallels between sentence gram- 
mar and text in categories. She sees the subject-predicate relation- 
ship in the sentence as similar to the topic-organizational development 
relationship in text structure. She also says that "one of the simplest ways 
to observe and follow significant order ... is to pay close attention to the 
connectives in the passage" (27). Her list includes additives (like and and 
then), comparatives (as), disjunctives (bill), alternatives (on the other hand), 
causal subordinates (if), descriptive subordinates (who), and temporal 
and spatial locatives (xvhere). Like others. Miles warns that the connec- 
tives do not tell the whole story. Word order and sentence position are 
also important: "In composition, the selection of material is supported 
and conditioned by the ordering of the material, its position, and the de- 
vices signalling order, the connectives" (27). 

How does one analyze organizational structures that cannot be 
counted? Paul B. Diederich's analytic scale (1974) is one answer This 
scale assumes that one can identify the distinct qualities of good writing 
and select out these qualities for individual ratings. Diederich recom- 
mends that beginning readers, in assessing writing, should give rank- 
ings for ideas, organization, wording, and flavor Each item is 
accompanied by a description of high, medium, and low qualities and 
sometimes by sample papers illustrating that item, with a score. After 
some experience reading and scoring papers on particular criteria, 
readers, according to Diederich, should be able to "move easily and nat- 
urally into the use of standard scores . . . rating on general impression" 
(55). "General impression scoring" means the same as holistic scoring. 
Because these days many teachers have had experience reading papers 
in controlled situations, many school districts reverse the order Dieder- 
ich recommends. After holistic scores are given, teachers assign scores 
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for organization, coherence, ideas, and any information that is impor- 
tant to the writing curriculum. 

Another assumption of Diederich's analytic scale b that the organi- 
zation and cohesion issues will be fundamentally the same in all papers. 
This is not necessarily the case. For this reason, scales and their descrip- 
tions are sometimes prepared for each reading. 

Part of the theoretical support for scales like Diederich's comes from 
the work of C. E. Osgood, G.J. Suci, and R H. Tannenbaum (1957) with 
the semantic differential. In their scale, subjects were to characterize 
such things as Fatlur (26): 



happy 

hard 

sk)W 



X 



. X 


Father 






. X 





, : sad 
, : soft 
. : fast, etc. 



In the above wsijather is described as "slighdy happy, quite hard, and 
slightly fast." The scale provides a way for turning words into relative 
numbers and turning the numbers into a semantic average. Osgood and 
his collaborators sampled responses to such scales from given speech 
communities and treated the degree of agreement among answers as a 
significant and measurable variable distinguishing one group from 
another 

This procedure is quite similar to the way analytic scales are used. 
First of all, the scales themselves have rankings from "good" to "poor" 
on such matters as organization, very much like the scale from "happy" 
to "sad" above. Furthermore, when readers use the scales to score an- 
chor papers, they are developing a semantic average for organization in 
those papers, and this average is intended to control the readings of in- 
dividual readers so that they score features in the same way Differences 
from one set of anchor papers to another distinguish among points on 
the ranking scale. 



Lesson, Topic, and Test Conditions 

A common lesson emphasizing global judgments is the use of scrambled 
paragraphs. Well-written paragraphs are scrambled, and students are 
asked to put the sentences in order. Then the class discusses the reasons 
for the various versions. Another lesson is the modeling or imitation les- 
son (Myers and Gray 1983, 15-18). In general, the lessons and conditions 
of tests and topics are the same as those mentioned in previous sections 
of this chapter. 
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Coding of Organizational Structures 

Different scales are used for the scoring of distinct structures. Below is 
a scale from Diederich ( 1974, 54-57). 



Topic Reader Paper 





Low 




Middle 




High 


Ideas 


2 


4 


6 


8 


10 


Organization 


2 


4 


() 


8 


10 


Wording 


I 


2 


3 


4 


5 


Flavor 


I 


9 


3 


4 


5 


Usage 


1 


2 


3 


4 


5 


Punctuation 


I 


2 


3 


4 


5 


Spelling 


I 


2 


3 


4 


5 


Handwriting 


I 


2 


3 


4 


5 

Sum 



Readers who use Diederich's scale total ideas, organization, wording, 
and flavor and then total usage, punctuation, spelling, and handwriting. 
These two totals are then added together Before using the scale, readers 
must discuss what the various terms mean, and the resulting definitions 
must then be recorded and distributed. Below are examples of defini- 
tions for low and high scores in ideas and organization: 

Ideas 

High — The student has given some thought to the topic and 
writes what he really thinks. 

Low — It is either hard to tell what points the student is trying to 
make or else they are so silly that .... 

Organizalion 

High— Hie paper starts at a good point, has a sense of move- 
ment, gets somewhere, and then stops. 

Low — ^This paper starts anywhere and never gets anywhere. 

Another kind of scale is one developed by the National Assessment of 
Educational Progress (1980, 1:32) for cohesion. 

Cohesion Scoring Guide Categories 

1 = Little or no evidence of cohesion: clauses and sentences are not 

connected beyond pairings. 

2 = AttempLs at cohesion: evidence of gathering details but little or 

no evidence that these details are meaningfully ordered. 
Very little would seem lost if the details were rearranged. 
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3 = Cohesion: details are both gathered and ordered. Ck)hesion 

does not necessarily lead to coherence, to the successful 
binding of parts so that the sense of the wlioie discourse is 
greater than the sense of its parts. In pieces of writing that 
are cohesive rather tiian coherent, there are large sections 
of details that cohere but these sections stand apart as 
sections. 

4 = Coherence: while there njay be a sense of sections within the 

piece of writing, the sheer number and variety of cohesion 
strategies bind the details and sections into a wholeness. 
This sense of wholeness can be achieved by a saturation of 
syntactic repetition throughout the piece and/or by closure 
that retrospectively orders the entire piece and/or by gen- 
eral statements that organize the whole piece, 

llie following is an example of a scale designed to icientify organiza- 
tional qualities associated with a particular topic — in this case, a com- 
pare and contrast essay. The developers felt that the scale represented a 
hierarchy of skill in organizing a particular topic, with the highest level 
"appearing to arise out of the use of experimental materials by more 
able students" (Gray and Keech 1980, 35). 

Compare/Contrast Scale 

0 = no apparent organization, random association of ideas or 

confusing changes of direction, ^a) 

1 = ''integrated" or point-by-point comparison; usually three to 

seven sentences listing differences or similarities between 
the items being compared or contrasted; no development or 
larger framework of organization, (b, c, d) 

2 = "bi-polar"; each item of comparison is examined in some 

detail separately, usually in its own paragraph, with a min- 
imal introductory or concluding sentence used to name a 
preference or draw a comparison, (e, f, g) 

3 = essentially "bi-polar" in main development, but has at least 

a paragraph of introduction or conclusion which contains 
one or more combining sentences establishing a compari- 
son. These papers may also have transitional devices or 
comparing terms scattered through the "bi-polar" para- 
graphs, (h, i,j) 

4 = "integrated," for the most part, throughout, but unlike 

Type One, contains some development and some movement 
from one idea to the next; may be more detailed than Type 
One, or may relate the entire body of the comparison to 
other abstract questions such as "how do we choose where 
to shop?" (k, 1, m) 

Charles Cooper (1977, 15) reports on the development of the following 
two scales by four Buffalo-area English teachers— Greg Anderson, Dale 
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Kaiser, Nathalie Ketterer, and Donald McAndrew. Neither of these 
scales should be used without reading Cooper's description for each 
item on the scale (1977, 21-24). 



Reader 



Analytic Scale 

Paper 





Low 




Middle 




High 


I. General Qualities: 












A. Author's Role 


2 


4 


6 


8 


10 


B. Style or Voice 


2 


4 


6 


8 


10 


C. Central Figure 


9 


4 


6 


o 


10 


D. Background 


2 


4 


6 


8 


10 


E. Sequence 


2 


4 


6 


8 


iO 


F. Theme 


2 


4 


6 


8 


10 


IL Diction, Syntax, and 


Mechanics: 








A. Wording 


1 


2 


3 


4 


5 


B. Syntax 


I 


2 


3 


4 


5 


Usage 


1 


2 


3 


4 


5 


D. Punctuation 


1 


2 


3 


4 


5 


E. Spelling 


1 


2 


3 


4 


5 



Reader 

YES 
L 



Total 

Dichotomous Scale 

Paper 



NO 



II. 



Author's role consistent 
Interesting personal voice 
Theme clearly presented 
Background rich and supportive 
Sequence of events clear 
Central figure fully developed 
Wording unique and developed 
Syntax correct and varied 
Usage errors few 
Punctuation errors few 
Spelling errors few 

Total Yes 



Pattmis of Use 

Substantial information is available on the use of various scales. In one 
school district reading of papers from seventh through twelfth grades, 
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the students in the upper quartile averaged a sum of 22,5 on the Died- 
erich scale above, and students in the lowest quartile averaged 9, On the 
cohesion scale, the NAEP (1980) reports the percentages in table I for 
seventeen-year-olds at each cohesion level over a ten-year period. 

The Gray/Keech scale for a particular comparison topic showed the 
following distribution among eleventh and ninth graders who had been 
taught how to write comparisons: 

Organizational Rating 

0 1 2 3 4 

9th Graders 5,9% 52,9% 29,4% 0 1 1 ,8% 

II th Graders 0 4,2% 16,7% 16,7% 62,5% 

Teachers who use scales are often suspicious of such counts as T- 
units, but they need numbers for the purpose of repordng to adminis- 
trators or other teachers what is happening in the classroom. Scales pro- 
vide numbers and allow for global impressions. Teachers who use 
analytic scales such as Diederich*s should know that Lynn Winters (1979, 
25) found that the Diederich scale (DES) and the Winters CSE scale 
(Current School Education, derived from current composition text- 
books) correlate better with General Impression (GI) or holistic scores 
than they do with T-unit counts (see table 2), 



Table 1 

Percentages of 17- Year-Olds at Each 
Cohesion Score Level, "Stork" Exercise, 1969, 1974, 1979t 



Year Score Point 







Non- 


Inade- 


Attempts 


Cohesion 


Cohesion 


Coliesion 






rate- 


quate 


at 




and 


or 






able 




Cohesion 




Coherence 


Better 






0 


1 


2 


3 


4 


3&4 


1969 (n 


- 2,073) 


1,0% 


0,8% 


17,8% 


67,2% 


13.2% 


80.4% 


1974 (n 


= 2,281) 


1,5 


0,6 


19.7 


64.1 


14.1 


78.2 


1979 (n 


= 2,748) 


0,9 


0,6 


12,1 


70,9 


15.5 


86.4 


Change 
















1969- 


-74 


0,5 


-0,2 


1,9 


-3,1 


0.9 


-2.2 


1974- 


-79 


-0,6 


0,0 


-7,7* 


6,8* 


1.4 


8,2* 


1969- 


-79 


-0,1 


-0,2 


-5,7* 


3,7 


2.3 


6.0* 



*Statisticaiiy significant at the .05 level. 

t Percentages may not total due to rounding error. 
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Intercorrelations among Scoring Systems 



System 


GI 


Total Sample 
n = 80 

DES 


CSE 


T-Unit 


GI 










DES 


.82 








CSE 


.79 


.86 






T-Unit 


.004 


.06 


.001 





Descriptive Studies of Texts 

Instead of counts and numerical marking of features, some teacher-re- 
searchers prefer a descriptive, case-study approach to analyzing texts. 
The following selection from a study by Ruby Bernstein (Concord H^gh 
School, Concord, California) and Bernard Tanner (Cubberley High 
School, Palo Alto, California) illustrates the approach (1977, 15-17): 

Paper B (11) High score— 5 

I believe physical education should be continued in high school, 
but in a more progressive system. As it is now many kids shy away 
from PE. because of several reasons. One is that the competition is 
too much. When you have winners, you've got to have losers. Com- 
petition is healthy, but I think we place too much importance on 
being king of the mountain. A more beneficial system would be hik- 
ing, or bike riding. Those who want to come in first can do so, but 
the emphasis should be in bringing out the full athletic potential in 
each student, instead of those who don't need P.E., they are active 
enough as it is. Also, by forcing PE. on kids, you make them reject 
it that much more. iT we had a system by which each student could 
bring out the good inside we would have a much better attendance 
record and grade average too. 

Paper B (40) High score— 5 

I believe physical education should not be required in high 
school. It accomplishes nothing and is a waste of money. 

The only reason I can see for physical education being taught in 
school is, the school officials believe it keeps the person in shape. 
This is untrue. If the person doesn't want to participate they won't 
and nothing can be done to change this. Also, the time alotted for 
this class is insufficient. The actual time spent in the activity is ap- 
proximately 30-40 mins. This does nothing for the individual. It is 
the individual's responsibility to keep their own body shape. If they 
fail to do this, then they must suffer the consequence. 
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1 am not saying physical education shouldn't be taught, I'm just 
saying it shouldn't be required. It isn't a course that will help you 
when you leave school. Physical education is just line as an elective 
and that's what it should be. If it is made an elective, it just might be 
fun. 

Discussion of B (11) and B (40) 

These papers from the top category demonstrate obvious 
truths — one, that top level papers are by no means perfect; and two, 
that papers in a given scoring category by no means have a stereo- 
typical samene.ss. 

B (11) consists of a single, fairly well-formed paragraph, begin- 
ning with a topic sentence which takes a "clearly defined" and almost 
unique point of view rather than a mere pro or con stance, thus at 
the outset suggesting "complex reasoning." The paragraph sup- 
ports the point of view with two arguments against the present sit- 
uation as well as two suggestions for improvements possible in a 
more "progressive system." The reasoning contains "particular ex- 
amples" in the matters of "hiking or bike riding," has at least one 
effective use of diction ("king of the mountain"), and shows some 
imagination in foreseeing outcomes of better attendance record 
and grade averages (see concluding sentence). In sum, although the 
paragraph is somewhat loose in its matters of reference (and even 
contains one comma-splice), it tends to be reasonably coherent and 
provides a majority of the key aspects listed for a 5 paper. 

B (40) uses the available lined space on the examination paper to 
offer an answer which has an obvious beginning, middle, and end, 
with a topic paragraph which takes a specific stimd, and a conclud- 
ing paragraph which has the grace of an effective clincher sentence. 
The central paragraph contains fairly complex reasoning to explain 
why the writer believes physical education does not meet the key ob- 
jective for which (the writer assumes) it is intended, with at least two 
specific supporting explanations. Overall the paper contains nota- 
bly effective diction ("accomplishes," "participate," "alotted Isicl" 
"insufficient," "individual," "approximately," "responsibility," "con- 
sequences"). Although this paper does show problems with refer- 
ents (consistency of number in "person/they" and vague-referent 
"this"), it is otherwise reasonably free of error. 



Suggested Studies 

1 . Does the average level of generality change from grade to grade or 
from A papers to C papers? 

2. Do teacher-readers agree on what is subordinate and what is co- 
ordinate in student essays? 

3. How do students phrase their main ideas? This question was ad- 
dressed in a descripuve study by teacher-researcher John A. Hig- 
gins(1975). 
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4. Under what conditions do students increase their uses of parallel- 
ism and compare/contrast terms? This question was addressed by 
teacher-researcher Miki Yamagishi (1980) as part of her research 
work in the secondary credential program of the Bay Area Writ- 
ing Project. 

5. Do students learn to imitate models? Many teacher-researchers 
have conducted studies of this question. 
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4 Cognition: 

Information Processing 



In Piaget's cognitive perspective, language learning is an interaction be- 
tween external stimuli and an organism's internal structure. The mech- 
anisms of this interaction are the processes of assimilation and 
accommodation. In the former, the learner shapes reality to fit internal 
cognitive structures. In the latter, the learner modifies internal struc- 
tures to fit the apparent properties of the external stimuli. In such in- 
teractions, both the external world and internal cognitive structures can 
be transformed. 

The learner, then, begins with an internal cognitive structure, which 
in the case of reading and writing can be a mental representation of a 
text. This mental representation or plan enables the reader or writer to 
have hypotheses about what might be coming next in that text. Ex- 
amples of such plans are the five basic types of organization identified 
by Bonnie Meyer (1982) — comparison, description, response, time-or- 
der, and antecedent/consequent. If one predicts what is coming next 
based on a guess that the text has a time-order plan, then one expects 
chronology and reads the text as chronology (assimilation) until such 
time that that guess stops working. Then one modifies the time-order 
plan (assimilation) or shifts to a completely different plan 
(accommodation). 

In addition to a mental representation of a text or a writing plan, a 
writer may have a mental representation of cognitive procedures them- 
selves. Theories about cognitive procedures are called metacognition. 
Three examples of cognitive procedures are (1) the underlining of text 
for later review, thereby breaking the reading task into two parts, read- 
ing itself and review; (2) taking notes while reading, thereby using par- 
aphrasing as an aid to understanding; and (3) putting one's finger on 
the text as an aid to focusing one's eyes on the correct line. This chapter 
focuses on both types of mental representation concurrently, first ex- 
amining the size of the structures being processed and second exam- 
ining the steps of processing and the relationship between steps and 
structure. 
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1 Feature: The Size of the Units Processed 

Theoiy: Cognitive Psychology and Information Processing 

Information is processed through two types of memory, short-term and 
long-term, using two types of memory retrieval, automaticity and atten- 
tion. Automaticity results when, through practice, processes become 
consolidated, and memory retrieval becomes automatic. Attention op- 
erates as a spotlight on memory, and its memory retrieval is slow. 

In all writers, the two mechanisms of memory activation, automaticity 
and attention, are at work, and can occur simultaneously (Posner and 
Synder 1975). In the competent writer, the mechanism of automaticity 
responds to the act of putting letters on a page with two types of analysis. 
First, there is low-level stimulus analysis of the shape of die letters them- 
selves and of the procedures necessary — holding the pencil, staying on 
the line. At the same time, automaticity in the competent writer results 
in high-level semantic analysis of the words and the blocks of meaning 
associated in memory with the particular words being written. Auto- 
maticity is fast, does not use attention, and does not inhibit retrieval. Si- 
multaneously, the mechanism of conscious attention focuses on the 
mental representations of meaning, acuvadngone as the basis for pre- 
dictions about what is coming next and inhibiung other information 
coming from other locations in semantic memory. Attention is slow, has 
limited capacity, and inhibits the retrieval of informadon from unex- 
pected locations in semantic memory. 

In writers who lack adequate automaticity, a compensatory principle 
is always at work. When the formation and recognition of words is not 
autonratic, then attention will intervene and take over the function of 
low-level sdmulus analysis (Stanovich 1980). Because attenUon has lim- 
ited capacity, the use of attention for low-level sdmulus analysis reduces 
the amount of attenUon available for high-level semantic analy.sis. This 
compensatory principle predicts that students who have difficulty en- 
coding letters automatically will not have adequate attention capacity to 
integrate large blocks of meaning into a text. 

The two mechanisms, automaticity and attenUon, retrieve informa- 
tion from two types of memory, short-term and long-term. Long-term 
memory is the storehouse for knowledge about the world and is believed 
by some to have an unlimited capacity in normal circumstances. Short- 
term memory is a temporary storehouse for material that is being rec- 
ognized and attended to, and it has a limited capacity of about seven 
items, plus or minus two (Miller 1956). Information in short-term mem- 
ory will decay unless rehearsed. Short-term memory is sometimes called 
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"immediate" or 'Svorking" memory, and its limited capacity is called 
"memory span." The process for increasing the amount of information 
in short-term memory is called "chunking." 

Information-processing theory predicts ways of improving the auto- 
matic encoding skills of students, increasing the amount of information 
that attention can scan in short-term memory, and increasing the length 
of time that information can be stored in short-term memory. First, 
practice improves automaticity (LaBerge and Samuels 1974), putting in 
memory a more efficient copy of procedures for holding the pencil, 
shaping lettiers, and so forth. Practice or rehearsal can also increase the 
length of time that information can be held in short-term memory. In 
addition, students can be taught various devices for storing information 
in short-term memory and avoiding the overburdening of short-term 
memory. Drafts, notes, maps, and other paper records are common de- 
vices used for recall. 

Second, practice in chunking increases the amount of information 
that can be held in short-term memory and then analyzed by attention 
capacity (Miller 1956). Short-term memory has a limit of seven units, but 
the amount of information in a unit can vary. Chunking is the process 
of taking several units of meaning (e-t-t-x) and consolidating them into 
one larger chunk of meaning ( text). By changmg the seven units in short- 
term memory from seven letters to seven words, one can increase the 
amount of information stored in short-term memory. Learning how 
ideas are connected to one another in a single, meaningful pattern is a 
common strategy for chunking material into fewer units. In general 
then, the information-processing system used to write looks something 
like figure 8. 



Sensory 


-> 


Percep- 


Stimuli 




tion 



Short- 
term 
Memory 



Long-term 
Memory 



Attention 



Accommodation 
and 
Assimilation 
Translation 
Functions 



Automatic Activation 



Response 



Automatic Reaction 



Figure 8. In formation -processing system used in writing. 
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The outline of cognitive theory presented here has its areas of con- 
troversy. For one thing, some theorists think that items do not reside in 
short-term or long-term memory but are at different levels of analysis. 
They think of the memory system in terms of depth of processing, not 
storage in a place. Another area of dispute is how to do task analysis — 
what are the chunks of processing, and what are the parts and the 
wholes? 

Lesson: Fluency 

Lessons that focus on fluency are attempting to increase the size of the 
units that the writer is able to process automatically, thereby releasing 
attention for organizing larger blocks of meaning. In some school dis- 
tricts, about 20 to 30 percent of the students lack adequate automaticity 
in low-level stimulus analysis (at the level of letters and words). Lessons 
to increase fluency or automaticity begin by asking students to write 
without worrying about "errors" and handwriting, thereby discourag- 
ing students from using their attentional capacity for low-level stimulus 
analysis and encouraging them to leave attention free to attend to pur- 
pose and function, "Just get the idea down" and "Think about your 
story and where it's headed" — these are the teacher remarks that guide 
attention. The writing in these lessons takes the form of journals, drafts, 
letters, notes — any form allowing for informality in diction and casual 
organization. Networking ideas, vocabulary development — these are ap- 
proaches to chunking. 

Making students aware of the processes they use when they write is a 
new emphasis in many lessons. An example of this approach is the chap- 
ter "Understanding Your Own Writing Process" in Linda Flower's 1981 
textbook, Problem-Solving Strategies for Wnting, 

Topic and Test Conditions 

The topic and test conditions influence the size of the units processed. 
An emphasis on spelling and other matters of small-unit correctness 
will, of course, increase the allocation of attention capacity to small units 
and decrease the attention available for large units. Another topic and 
test condition variable is the amount of information provided in the test 
topic. Suppose students were asked to write either on one passage or on 
three passages from various works. One might expect that the three- 
passage topic would take longer to read and cause the low-competency 
students to write less. But this is not the case, William L, Smith (1983) 
found that topics asking for response to one passage generated far fewer 
words from low-competency students than did a topic with three pas- 
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sages for comment. Giving more information in the topic apparently 
helps such students write more. 

The analysis of unit size may require, as noted below, a test condition 
in which students are given the opportunity to make revisions. If the 
emphasis is on automaticity as reflected in length, then the test condi- 
tions might provide a strict limit on the amount of time a student can 
use. 

Coding the Features of Unit Size 

Three formulas used to code the size of the units being processed are 
pauses during writing, the length of the writing sample, and the size of 
the units that are revised or changed on a second reading. Pause studies 
are generally not practical for teachers in schools, but several examples 
are available as models if this approach is desired (Matsuhashi 1981; 
Myers 1983). The formula for length is a simple count of total words, in- 
dicating how much the student was able to process in a given time. 

One formula for unit size in revision is suggested by Lillian S. Brid- 
well (1980). In this formula, the students are given time to review the es- 
says they have written and to make revisions using pens with distinctive 
colors. These revisions are then coded and counted, using the following 
categories (1980, 203-4): 

1 . Surface Level 
LI Spelling 

1.2 Punctuation 

1.3 Capitalization 

1 .4 Verb form 

1.5 Abbreviations vs, full form 

1.6 Symbols vs. full form 

1.7 Contractions vs. full form 

1.8 Singular vs. plural 

1 .9 Morphological cond itioning 

LID Interlinear and marginal notations related to any of the 
above 

2. Lexical Level 

2.1 Addition 

2.2 Deletion 

2.3 Substitution (synonyms, pronouns) 

2.4 Order shift of single word 

2.5 Interlinear and marginal notations related to single 
words 

3. Phrase Level 

3.1 Addition 

3.2 Deletion 

3.3 Substitution/alteration 

3.4 Order shift of complete phrase 
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3.5 Expansion of word to phrase 

3.6 Reduction of phrase to word 

3.7 Interlinear and marginal notations related to phrases 

4. Clause Level 

(Subordinate or independent not punctuated as sentence) 

4. 1 Addition 

4.2 Deletion 

4.3 Substitution/alteration 

4.4 Order shift of complete clause 

4.5 Expansion of word or phrase to clause 

4.6 Reduction of clause to word or phrase 

4.7 Interlinear and marginal notatiorrs related to clauses 

5. Sentence Level 

(as punctuated by student) 

5. 1 Addition 

5.2 Deletion 

5.3 Substitution/alteration 

5.4 Order shift of complete sentence 

5.5 Expansion of word, phrase, or clause to sentence (in- 
cludes de-coordination) 

5.6 Reduction of sentence to word, phrase or clause (in- 
cludes coordination) 

5.7 Transformation 

5.8 Interlinear and marginal notations related to sentence 

6. Multi-sentence Level 

(two or more consecutive sentences, categories 6.1-6.5 tallied 
once for each sentence involved) 

6.1 Addition 

6.2 Deletion 

6.3 Substitution/alteration 

6.4 Order shift of two or more sentences 

6.5 Reduction of two or more sentences to single sentence 
(excepting those changes accounted for by category 
5.6, clause, phrase, or word) 

6.6 Indention 

6.7 De-indention 

6.8 Interlinear and marginal notations related to multiple 
sentences 

7. Text Level (Not included in analysis) 

7.1 Change in function category of essay 

7.2 Change in audience category of essay 

7.3 Change in overall content of the paper 

7.4 Total re- write of essay with few or no one-to-one corre- 
spondences between sentences 



Patterns of Use 

Bridwell found that her twelfth-grade students with low holistic scores, 
using summary scores from Diederich's scales, made an ''overwhelming 
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majority" of their revisions at the surface and word (lexical) levels, The 
students with high scores, on the other hand, had only a few more total 
changes but "far fewer surface-level changes." In the substitution of sen- 
tences, the high-scoring students substituted far fewer consecutive sen- 
tences. In other words, the low-scoring students more often substituted 
several consecutive sentences in one block. This kind of revision repre- 
sents the tendency among k)w-scoring students to start over rather than 
revise, possibly caused by their failure to give adequate attention to mat- 
ters of overall organization and purpose. 

A second indicator of proce.ssing .skill is length. Table 3 (Myers 1982, 
109) shows the number of words per writing sample of an essay ("explain 
why someone is a favorite person") and a letter, distributed by score cat- 
egory. 1 he samples were holistically scored by two readers on a l-to-6 
scale, and the two scores added together. 

One especially interesting pattern in the data above is the tendency of 
k)w writers (group 1) to write more words on letters, whereas all the 

Table 3 

What Is the Average Number of Words Per 
Writing Sample in Each Score Category? 

mi Essays 



Group 


Count 


Mean 


.V./;. 




9o7( Conj: Int. 


1 




40.:^ 158 


17.85 


2.89 


:^1.4483U) 46.18:^2 


9 




119.8:^:^3 


:^8.06 


6.34 


106.9530 to 132.7137 


'^ 


11 


149.1818 


:^3.2i 


10.01 


126.8685 to 171.4952 


4 


2() 


20:10:^85 


:^5.96 


7.05 


188.5124 to 217.5645 


TOTAL 


111 


115.0090 


69.61 


6.60 


101.9149 to 128.1031 


mi Letters 


Group 


Gmint 


Almn 




SJL 


957c Conj: Int. 


1 




64.04:^5 


:^5.4i 


7.38 


48.7289 to 79.3580 


2 




97.1944 


22.73 


3.78 


89.5027 to 104.8862 


:^ 


'^] 


122.0:^2:^ 


26.3:^ 


4.72 


112.3737 to 131.6908 


4 


12 


HiO.OOOO 


28.57 


8.24 


141.8422 to 178.1578 


TOIAL 


102 


104.65()9 


39.99 


3.95 


96.8020 to 112.5117 
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other writers wrote more words on essays. One interpretation might be 
that low writers are more fluent when the audience is more personal, as 
is the case in the letter A study of data of this type in a school district 
might provide a basis for arguing that the district's writing program 
should give more emphasis to personal writing. 

2 Feature: Procedures for Processing 

Theory: Metacognition 

A writer must use not only information about how texts are organized — 
comparison, description, and so forth — but also information about how 
to process information efficiently. These processes or metacognitiye 
procedures have been the focus of a substantial body of research (Emig 
1971; Graves 1975) showing that writing is an act of discovery (accom- 
modation) for both skilled and unskilled writers (that is, writers often 
have only a vague idea of what they are going to write about when they 
first start); that the writing process is not linear but recursive, moving 
back and forth across the page; that the writing process often develops 
in stages, from drafting to finished copy; and that writers appear to pass 
through developmental stages as they grow as writers. 

Lesson: Prewriting and Revising Strategies 

In teaching practice, metacognitive theory has led to the introduction of 
teaching approaches that break the task into parts— note taking or map- 
ping, talking, prewriting, revising — all providing the student with pro- 
cedures for reducing possible overload on short-term memory. Mapping 
techniques, for instance, range from actual drawings to clustering and 
outlines. Talking can take the form of writing groups, collaborative writ- 
ing in teams or pairs, class discussion, or even the use of a series of ques- 
tions or heuristics to get ideas flowing or to review what is written (who? 
what? when? where? why?). 

Topic and Test Conditions 

The study of metacognitive procedures often requires that students be 
given enough time to write more than one draft and be provided enough 
paper so that they can map or prewrite if they choose to. All writing 
should be submitted and should be coded for the time spent in writing. 

The study of writing processes often requires that the sample be re- 
stricted to one or two students. Schools almost never do case studies as 
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part of their assessment progvam, having focused almost entirely on 
writing products as the goal of instruction. However, the study of pro- 
cesses seems particularly appropriate to show the growth and develop- 
ment of young writers and the positive changes in the writing of students 
who may still be below a school district's standard for minimum com- 
petency in writing. 

Coding Cognitive Procedures 

The formulas for coding cognitive procedures focus on changes in writ- 
ing procedures from one stage of writing (or draft) to another and on 
the different procedures used by different writers. One example of a 
study of procedural changes is Bridwell's study of the kinds of revisions 
that were made on three different drafts of the same paper Her formula 
calculated the total of each type of revision on each draft and then the 
percentage of each type of revision on each draft. 



Percentage of each Number of revisions of a 

type of revision on particular type on a given draft 

a given draft Total number of revisions on all drafts 

Coding the processes of writing in terms other than revisions is very 
difficult. Some researchers have tried collecting the prewriting of stu- 
dents and classifying this material into mapping, journals, and so forth. 
The results do not tell us very much, however, about the development of 
the students as writers. One problem is that many students prewrite by 
thinking and not by writing. To capture thinking patterns, scholars have 
tried four approaches: (1) interviews after the writing episode, inquir- 
ing into what students were thinking before and during the writing 
sample; (2) observation of the writer during the writing process (Graves 
1975); (3) videotaping of pauses during the writing episode (Matsuhashi 
1979), examining the location and length of these pauses; and (4) au- 
diotaping of students who reflect and compose aloud while they are writ- 
ing (Emig 1971; Perl 1979; Flower and Hayes 1981). All of these 
approaches exce pt perhaps for videotaping can be used by most schools. 
All of these approaches, however, restrict the sample studied to a few 
cases. In most school situations, one or two students are the limit be- 
cause case studies generate large amounts of data which require an 
analysis not easily reducible to a formula and, therefore, not easily 
understood by those not in the classroom. 

The interview approach has the serious drawback of students* not re- 
membering what they were thinking and doing at a particular moment 
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in their writing, and the observation approach has the drawback of re- 
quiring die presence of the investigator during the entire writing epi- 
sode. What Flower and Hayes call protocol analysis, using audiotapes, is 
very practical in most school situations. In Perl's use of this approach, 
she had the students compose aloud and write with a pen, and the 
audiotape captured both what the student was saying and die sound of 
the pen moving across the page. The use of the pen meant that material 
could be crossed out but not erased. Using die tape and the writing 
sample, Perl then coded the student's writing behaviors into the follow- 
ing categories (1979, 320-21) (see Perl's report for an example of her 
coding sheet, using the coding abbreviations listed below): 

(1) (General planning [PL]— organizing one's thoughts for writ- 
ing, discussing how one will proceed. 

(2) Local planning [PLL]— talking out what idea will come next. 
C^) (Mobal planning [PL(i] — discussing changes in drafts. 

(4) Commenting [C] — sighing, making a comment or judgment 
about the topic. 

(5) Interpreting [I] — rephrasing the topic to get a "handle" on it. 

(6) Assessing [A( + ); A( -)]— making a judgment about one's 
writing; may be positive or negative. 

(7) Questioning [Q] — asking a question. 

(8) Talking leading to writing [T^VV]— voicing ideas on the 
topic, tentatively finding one's way but not necessarily being 
committed to or using all one is saying. 

(9) Talking and writing at the same time f LW] — composing aloud 
in such a way that what one is saying is actually being writieii 
at the same time. 

(10) Repeating [re]— repeating written or unwritten phrases a 
number of times. 

(11) Reading related to the topic: 

(a) Reading the directions [R^] 

(b) Reading the question [RJ 

(c) Reading the statement [Rs] 

(12) Reading related to one's own written product: 

(a) Reading one sentence or a few words [R'] 

(b) Reading a number of sentences togetlier [R-' '*] 

(c) Reading the entire draft through [R'"] 

(13) Writing silently [W] 

(14) Writing aloud [TW] 

(15) Editing [E] 

(a) Adding syntactic markers, words, phrases, or clauses 
[Eadd] 

(b) Deleting .syntactic markers, words, phrases, or clauses 
[Edel] ^ ' 

(c) Indicating concern for a grammatical rule [Egr] 

(d) Adding, deleting, or considering the use of punctuation 
[Epunc] 
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(e) Considering or changing spelling [Esp] 

(f) Clranging the sentence structure through embedding, 
coordination or subordination [Ess] 

(g) Indicating concern for appropriate vocabulary (word 
choice) [Ewe] 

(h) Considering or changing verb form [Eve] 
(16) Periods of silence [s] 

From the codes listed above, Perl was able to get the following infor- 
mation about the student's writing process (322): 

(1) the amount of time spent during prewriting; 

(2) the strategies used during prewriting; 

(3) the amount of time spent writing each sentence; 

(4) the behaviors that occur while each sentence is being written; 

(5) when sentences are written in groups or ''chunks" (fluent 
writing); 

(6) when sentences are written in isolation (choppy or sporadic 
writing); 

(7) the amount of time spent betw^een sentences; 

(8) the behaviors that occur between sentences; 

(9) when editing occurs (during the writing of sentences, between 
sentences, in the time between drafts); 

(10) the frequency of editing behavior; 

(11) the nature of the editing operations; and 

(12) w here and in what frequency pauses or periods of silence oc- 



Flower, Hayes, and Swarts (1980) have given the following advice for 
those who wish to undertake a study of think-aloud data during the 
writing process: 

1. The hypothesis and then the coding scheme which will be used to 
analyze thin king-aloud data are developed. 

2. The subject works in an experimental room with a desk, writing 
materials, and a cassette tape recorder and tape. 

3. The subject is given a rough idea of the task, and is told, *The 
most important thing about this experiment is that we want you to 
say everything out loud as you are thinking and writing your essay, 
even if it has nothing to do with the task — stray remarks and ir- 
relevant comments are fine. We realize that it is impossible to say 
everything you're thinking while you're writing, so just try to say 
as much as you can." 

4. The essay and all notes are numbered in chronological order after 
the subject finishes the writing task. 

5. The tape recording is transcribed. 



cur in the process. 
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6. Then, using the hypothesis that determined the coding scheme, 
the transcript is parsed into appropriate units — lines and clauses, 
processes such as planning and reviewing, or composition 
episodes. 

Patterns of Use 

In the Bridwell study (1980), the patterns of revisions (percentages of 
each type) from one draft to another were as shown in table 4 (1980, 
207). 

The Perl study focused on unskilled writers involved in both personal 
reflections on a topic (reflexive) and impersonal, objective statements on 
similar material (extensive). The results in table 5 (1979, 325) on one stu- 
dent show that although the student spent more time prewriting in the 
extensive mode (7.8/8.0) than in the reflexive mode, the student wrote 
fewer woras. In fact, in session 1, the student wrote more words in the 
reflexive mode in less writing time (14.5/25.0/24.2 vs. 18.8/51.0). 

Sharon Pianko, using videotapes, also did a study of how students di- 
vided their time between prewriting and composing. Pianko's sample 
came from the remedial and traditional (regular) students in a com- 
munity college. She reported the patterns shown in table 6 (1979, 13). 

Descriptive Studies of the Writing Process 

Many teacher-researchers will want to attempt studies that are more de- 
scriptive of writing in a natural setting. Donald Graves's 1976 study of 
Michael is such a model of classroom research, which many teachers 

Table 4 

Percentages of Total Revision Rrequencies at Levels and Stages 



Stage 



Level 


A 


B 


C 


Level Percentage 


Surface 


9.00 


2.58 


13.25 


24.83 


Word 


12.87 


5.07 


13.30 


31.24 


Phrase 


5.66 


3.43 


8.91 


18.00 


Clause 


.86 


1.22 


4.23 


6.31 


Sentence 


1.30 


1.63 


4.88 


7.81 


Multiple-sentence 


1.16 


3.26 


7.28 


11.80 


Stage percentage 


30.85 


17.29 


51.85 





n = 100;/= 6,129 
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Table 5 

Tony: Summary of Four Writing Sessions 
(Time in Minutes) 





SI TW, 


S4 T-^W 


Drafts 


Wvnls 


Time 


Drafts 


WonL 


Time 


P-x tensive 
Mode 


Wl 
W2 

Total 


132 
170 

302 


Prewriting: 7,8 


Wl 
W2 

Total 


182 
174 

356 


Prewriting: 8,0 


18,8 
51,0 


29,0 
33,9 


Totcil 

composing: 91,2* 


Total 

composing: 82,0* 




S2TW, 




S5 


T-^W 


Drafts 


Words 


Time 


Drafts 


Words 


Tivie 


Reflexive 
Mode 


Wl 
W2 
W3 

Total 


165 
169 
178 

512 


Prewriting: 3,5 


Wl 
W2 
W3 

Total 


208 
190 
152 


Prewriting: 5,7 


14,5 
25,0 
24.2 


24,0 
38,3 
20,8 


Total 

composing: 76,0 


550 


Total 

composing: 96,0 



*TotaI composing includes time spent on editing and rereading, as well as actual 
writing. 



have found helpful in their own projects. Graves began with four class- 
rooms, each with writing folders kept by all the children, and narrowed 
his focus to Michael. In the classroom. Graves sat next to Michael, o!> 
served his every move while writing, and prepared the record shown in 
table 7 (1975, 232). 



IkbleG 



Factors 


Mean Scores 


F-ratio 


Remedial 


Traditional 


1, Prewriting time 
(minutes) 


1.00 


1.64 


5.2552-' 


2. Composing time 
(minutes) 


35,75 


43.29 


1.1831 


3. Rate of composing 
(words/minute) 


9.31 


9.29 


0.0001 


4. Rereading time 
(minutes) 


3.20 


3.71 ^ 


0.0741 
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Table 7 



Example of a Writing Episode 



A whale is eating the 


10:12 


9-Gets up to get dictionary. Has the page 


1 2 3 4 5 


R 


with pictures of animals. 


men. A dinosaur is 






6 7 8 (D ® (0) 12 


lU 


lO'Teacher announcement. 


triing to eat the whale. 


R 


1 1 -Copies from dictionary and returns 


13 14 15 16 17 @ 




book to side of room. 


A dinosaur is frowning 






(g) @> (g) 22 23 (S) 




18-Stops, rubs eyes. 


a tree at the lion, and 


RR 


19-Rereadsfrom 13 to 19. 


dD 26 27 28 29 30 31 32 


OV 


20- Voices as he writes. 


the cavman too. the men 


OV 


21 -Still voicing. 


33 34 35 @) 37 38 


IS 


24'Gets up to sharpen pencil and returns. 


are killed. The dinosaur 






39 40 41 42 43 


RR 


25-Rereads from 20 to 25. 


killed the whale. The 


RR 


36-Rereads to 36. Lost starting point. 


44 45 46 47 49 






@ 

cavman live is the roks. 




48'Puts away paper, takes out again. 


50 51 52 53 54 55 ID 


RR 


56-Rereads outloud from 49 to 56. 




10:20 





KEY: 1-2-3-4— Numerals indicating writing sequence. 0 — Item explained in 
comment column on the right. ////—Erasure or proofreading. T— Teacher in- 
volvement; IS— Interruption Solicited; lU— Interruption Unsolicited; RR— Re- 
read; PR— Proofread; DR — Works on drawing; R— Resource use. 
Accompanying language: OV— Overt; WH— Whispering; F— Forms letters and 
words; M — Murmuring; S — No overt language visible. 

An example of a descriptive study is Jerry Hermanns (1979) record of 
tutoring Brenda in the Laney Community College Writing Center, Oak- 
land, California. The following is a selection from one part of that re- 
port (1979, 10): 

Why doesn't the student come up with the correct form the first 
time? I suspect that students who are inexperienced writers try to 
write as they speak. For many who speak an American black dialect, 
"We done our best," would be an adequate spoken form, so Brenda 
wrote it that way without thinking about its correctness. Inexperi- 
enced writers are not accustomed to doing much, if any, proofread- 
ing, so the fact that other choices can be made after the initial 
composing process is nearly irrelevant. The tutor serves as editor 
(In the "real" world what professional writer doesn't have an edi- 
tor?), allowing choices to be made and mistakes corrected. This was 
a revelation to Brenda who — when she did write in school — wrote 
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something once. Let me correct that: She was asked to re-write 
things in school but for neatness, not content. To Brenda and who 
knows how many others, rewriting means nothing more than doing 
the piece over in your best handwriting— another unconscious de- 
ception that many teachers perpetrate on unsuspecting students. 

Another example of a teacher's descriptive study of a student's pro- 
cedures is Miriam Ylvisaker's report on her experiment encouraging 
fluency. The following is a selection from that report (1979, 7). 

At first Student A would ask only me for help in his proof-read- 
ing. He always wrote a rough draft and would bring it to me when 
everyone else in the class was busy (and unobservingof him) and ask 
me to point out errors. I underlined, he fixed those he could (on his 
own or with a dictionary), and then I looked at the paper again and 
told him where the problem lay with whatever errors he had not 
been able to correct. Then he wrote a clean draft. This was not a 
procedure 1 imposed on him; he initiated it. Later he became freer 
about asking for help, requesting aid from students as well as from 
me. "How do you spell it? How does this sound?" he would ask; . 
sometimes he would take the suggestions, but occasionally I heard 
him say, *'No, my way sounds better." Everything he wrote was re- 
lated in some way or other to sports. 

Teachers who, like Ylvisaker, trace classroom processes that contrib- 
ute to improved writing will often want to quote interactions among stu- 
dents and between teacher and students. The following illustration of 
this point comes from a classroom study by Deborah D'Amico, who 
teaches second and third grades in Brookline, Massachusetts (1984, 39-~ 
40): 

Ch: This story is boring. 

T: What's boring about it? 
C]h: I don't know. It's just dumb. All I'm doing is listing the people 
at my birthday party 
T: Was your party boring? 
Ch: No. 

T: What made it fun? 
Ch: We played some neat games and ate lots of food. 

T: Do you talk about the games in your story? 
Ch: I'm going to, but I still am writing who was there. 
V: Can you think of some other way to write about your party? If 
this writing is boring, maybe it needs a little excitement added 
to it. How might you do that? 
Ch: I don't know . . . maybe I could write about something fun that 
happened . . . 
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The results of the interaction above can later be traced in the student's 
writing, showing the impact of talk as a prewriting stage in the writing 
process, A descriptive approach is particularly useful in studies of the 
writing of young children, where coding distinctions may be particularly 
difficult. The following selection from a study by Diane DeFord shows a 
skillful researcher making a distinction between drawing and writing 
(1980, 158-59): 

hiitially, when a very young child takes pencil (or crayon) to pa- 
per and attempts to draw or write, an adult will typically think of it 
as only scribbling. The child, however, may very well say "That's a 
pumpkin." At this point, the child's control of the form of written 
language is not much different from the babbler's control of the 
form of oral language. "Ba-ba" may be a response to everything said 
just as scribbling may signify whatever the child intends at the mo- 
ment (the intent changing from moment to moment as well!). But, 
when this same child begins to bring subsequent attempts to a par- 
ent with the command "Read it to me," the basic function of writing 
is set. When the child makes the distinction between what is "draw- 
ing" and what is "writing," many rules that govern our use of written 
language rapidly follow. 

Kara, for example, at two years of age barely controls the move- 
ments required by the task of drawing her family (Figure 2a) and 
writing her name (Figure 2b). 

Bobby on the other hand, has enough physical control at three 
years to make his understanding of the basic distinction between 
drawing and writing very clear (See Figure 3). Physical control 
aside, both writers show that what they do for writing is different 
from what they do for drawing . . . 




Figure 2a. Kara — Age 2: family 
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Figure 2b. Kara's name 





Fij,:n-e 3. Bobby — Age 3: while writing at bottom, says, "This 
is a snowman and a man driving a hcHcopten" 



From "Young Children and Their Writing," Theon into Practice 19, 
no. 3 ( 1980): 158-59, publifhtd by the College of Education, Ohio 
State University. Reprinted by permission. 
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Teachers who desire to study the writing of children may find useful 
DeFord's stages of children's development in writing (162): 

L Scribbling 

2. Differentiation between drawing and writing 

3. Concepts of linearity, uniformity, inner complexity, symmetry, 
placement, left- to-right motion, and top-to-bottom 
directionality 

4. Development of letters and letter-like shapes 

5. Combination, of letters, possibly with spaces, indicating un- 
derstanding of units (letters, words, sentences), but may not 
show letter/sound correspondence 

6. Writing known isolated words— developing sound/letter 
correspondence 

7. Writing simple sentences with use of invented spellings 

8. Combining two or more sentences to express complete 
thoughts 

9. Control of punctuation-^periods, capitalization, use of upper 
and lower case letters 

10. Form of discourse— stories, information material, letters, etc. 



Suggested Studies 

L How do students begin their planning when they write? Laurie 
Williams (1979), a teacher-researcher in the credential program 
of the Bay Area Writing Project, used the methods of Flower and 
Hayes to study this question. Her data came from one eighth 
grader writing about Lord of the Flies^ 

2. How do professionals learn to write? Susan Swanson (1983), an- 
other teacher-researcher in the Bay Area Writing Project's cre- 
dential program, approached this question through interviews 
with professional writers. Tearhcr-researchers should know, how- 
ever, that Emig (1971) and others have expressed reservations 
about the accuracy of reports from professional writers, pointing 
to the absence of accuracy in Frost's responses in the Paris Review 
as one example. 

3. What are the stages of writing in the classroom? Patty Sue Wil- 
liams, a teacher-researcher from the Virginia Writing Project, ex- 
amined changes in the writing of twenty-four six-year-olds from 
September to March. She divided the analysis into three time pe- 
riods and then examined overall changes at the end of each time 
period. 
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Feature: Relationships among Speaker, Audience, 
Subject, and Text 

Theoiy: Pragmatics and Frame Semantics 

The theory of social context proposes that a piece of writing be under- 
stood as a social contract which is shaped by the status, roles, setting, 
and channel (e.g., typed, printed, handwritten) of the participants in 
the speech event (Hymes 1974; Brown and Fraser 1979; and Halliday 
1978). Bateson (1972) has argued that the social context is like a super- 
ordinate message that determines how a given act of communication is 
to be understood. When the superordinate message is "This is play" in 
an after-school game, for example, a slap will not necessarily be inter- 
preted as hostile. 

Research projects focusing on social context have been influenced 
first by linguistic theory from pragmatics and frame semantics, both 
stressing different linguistic roles in typical events (Fillmore 1976; Lak- 
off 1977); second by work in artificial intelligence showing that social 
events have set scripts— the restaurant sjript, for example, including a 
menu, a waiter/ waitress, and so forth ^Schank and Abelson 1977); and 
third by sociolinguistics, particularly the study of the purpose and func- 
tion of writing in various social settings (Odell and Goswami 1982). In 
general, the unit of analysis in the study of social context has been at one 
of four levels: (1) one of the overall purposes of writing (poetic, trans- 
actional, reporting, generalizing); (2) particular purposes (personal, 
logical, concrete, serious, humorous) in specific situations (different 
roles in a particular business, test responses in different countries); 
(3) different conventions in different speech events (conversations, lec- 
tures, courtroom declarations); and (4) different rules for different 
speech acts (requests, commands, questions). 

For a time, composition textbooks were almost always organized 
around the modes of writing, but in 1950 James McCrimmon published 
Writing with a Purpose, and since that time purpose and function have 
become increasingly important as an organizing principle in textbooks 
and research. Research organized around theories of overall purpose in 

89 
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writing has been heavily influenced by the communication triangle of 
speaker, listener, and subject. These factors were the basis for work from 
Aristotle's study of rhetoric (as analyzed in Berlo I960, 29) to James Mof- 
fett's theory of the universe of discourse: "The universe of discourse is 
staked out by a first person, a second person, and a third person; and 
their interrelationships make up the dynamics of discourse. So the con- 
cept I am referring to is the venerable trinity — I, you, and it; informer, 
informed, and information; narrator, auditor, and story; transmitter, re- 
ceiver, and message" (1968, 118). 

The components of the communication triangle have been used by 
different theorists in different ways to define purpose and function. For 
Moffett, purpose and funcdon are defined by the distances between 
speaker and subject and between speaker and audience. The distance 
between speaker and subject ranges from recording {I is close to subject 
which is happening now) and reporting (I is slightly removed from sub- 
ject which happened earlier) to generalizing {\ is removed from subject 
enough to give historical overview) and theorizing (I is very detached 
from subject, predicting things that have not happened yet). The dis- 
tance between speaker and audience, on the other hand, ranges from 
the close relationships reflection and conversation to the detached rela- 
tionships of correspondence and publication. 

For J. Britton et al. (1975), function categories are based on the 
speaker/subject relationship, separate from the speaker/audience rela- 
tionship. There are two writing functions, which originate in a single, 
ba.sic function, the expressive. After the initial development of an idea in 
the expressive, the writer decides whether to take the additional step of 
devek)ping the idea as €\i\\ev poetic or transactional writing. In the poetic 
function, the writer plays the role spectator to events, but in the trans- 
actional the writer plays the role o[ participanL In the former, the writer 
plays the role of a storyteller of actual and invented events, but in the lat- 
ter the writer is a doer involved in actual events, someone who is trying 
to get something done in the world. 

Another use of the communication triangle to define purpose is rep- 
resented by the work of Jakobson, Kinneavy, and Lloyd-Jones, each of 
whcMn defined purpose by emphasizing one part of the communication 
triangle. Roman Jakobson (I960) proposed a communication triangle 
with six components shaping purpose and funcdon in a communiradve 
event : 

CON'rEXT 
MKS.SAOK 

ai)I)RKSSi:r adoresskk 

CON lACr 
CODK 
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Each of these six factors determines a different function of language: 

RIU'ERKN riAL 

FMorivK poetic: oonativk 

PHA'nc: 

METAUNOUAL 

James Kinneavy (1971) reduced the triangle to four parts — speaker, lis- 
tener, reality, and signal — and suggested that purpose and language 
were determined by which of the four parts was being emphasized. If 
the purpose is to emphasize the speaker, or encoder, then expressive lan- 
guage is used. If the emphasis is on the listener, or decoder, then the lan- 
guage is pei\suadve; if on reality or subject, then referential; and if on 
signal, then literary. 

The National Assessment of Educational Progress (NAEP 1980), un- 
der the leadership of its consultants, Richard Lloyd-Jones and Karl 
Klaus, adopted a theory similar in many respects to that proposed by 
Kinneavy but restricted to three purposes: expressive (emphasizing the 
addresser), pe)\suasive (emphasizing the addressee), and explanatoij (em- 
phasizing the subject). In effect, NAEP decided that it would not assess 
literary writing by students in schools. 

These uses of the communication triangle in Moffett, Britton, Kin- 
neavy, and the NAEP report all aim for a definition of overall social pur- 
pose and function. One problem with m ich of the data in Moffett, 
Britton, and others is that all of the writing takes place in one social set- 
ting, American or English schools. Purves and others have added addi- 
tional contexts to these data by examining how school (or test) writing 
differs among different countries (Takala, Purves, and Buckmaster 
1982). In another study, Odell and Goswami (1982) took a somewhat dif- 
ferent approach. Instead of looking for an overall purpose in academic 
writing, they looked for particular purposes embedded in particular cir- 
cumstances in nonacademic settings. They studied, for instance, the 
writing" of people with different roles and status in a county social serv- 
ice agency. Their findings suggest that although there are context re- 
5traint:; that are of interest, writers, even in nonacademic settings, use 
some overall principles as guides. 

Another approach to the description of purpose in the social context 
is the speech event approach. This approach differs :om the other ap- 
proaches in that it shifts the emphasis from the anal 'si^ of speaker-au- 
dience- subject-text as separate dimensions to an analysis of how these 
relationships co-occur in given speech events. Indeed, J, Britton et ah 
found a strong association between the expressive function and a very 
close relationship between speaker and audience (1975, 184). The 
speech event approach emphasizes the contextual similarities between 
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oral and writlen language, assuming that the student brings to the writ- 
ing task the contextual rules learned in speaking. 

But what is a speech event and why is this unit of analysis critical? The 
social contexts of oral language can be divided into three different units 
of analysis: speech siiuaiions (football games, meals, fights, ceremonies), 
speech events (conversations, lectures, formal routines), and speech acts 
(commands, declaratives, interrogatives) (Hymes 1974, 51-53), Speech 
act theorists argue that the meaning oi an utterance is determined by its 
perloculionary and illocutionary force, not its grammatical features. 
Thus, *tMose the window" is understood as a command not because of 
matters like subject-verb agreement but because of its habitual speech 
act functions. Speech act theory, then, is a theory of function and pur- 
pose for individual sentences (Austin 1962; Searle 1969), but this frame- 
work has sometimes not provided an adequate description of language 
in social context. Hugh Mehan found in classrooms, for example, many 
examples of the speech act he called evaluation — those individual utter- 
ances ("Good," or "That's right' ; by the teacher in response to some stu- 
dent behavior. He found, however, that a speech act like evaluation could 
not be adequately understood outside the classroom sequences of iniu- 
ation-reply-evaluation (1979, 64): "Thus, individual acts of speech are 
not autonomous. The meaning of a given speech act is not contained 
within its internal structure. Instead, meaning resides in the reflexive as- 
sembly of initiation, reply, and evaluaUon acts into interactional 
sequences." 

What, then, are the interactional sequences for wriung? Myers (1982) 
suggests that student writing samples are organized around four speech 
events — encoding speech events, conversations, presentations, and rituals — 
and that each speech event combines the dimensions of speaker-reader- 
subject-text into a distinctive set of rules which are, to some degree, rec- 
ognizable by most students from their oral language experiences. 

Theories of purpose and social context are sometimes combined with 
a developmental perspective. Moffeu, in fact, has argued (1967, 117) that 
the movement from close subjects and audiences to distant ones parallels 
developmental patterns identified by Piaget: 

Hie thought and speech of the child, says Piaget, gradually so- 
cialize, adapt to a listener Adapting to a listener is exactly what suc- 
cessful rhetoric entails; the speakei* must embrace the other's world 
\5y incorporating his point of view and by speaking his language, 
'fhus Piaget enables us to tie rhetoric to the cognitive processes and 
to the basic biological fact of adaptation in general. 

Earlier studies of child language acquisition concentrated on wriung 
"grammars" of child language, but recent acquisiuon theory has at- 
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tempted to take into account the effects of context on language learning. 
The unit of analysis has typically been at two levels, the speech event of 
language acquisition, called 'd joint action format by Jerome Bruner (1974- 
75), and C-ads, or "protoconversational acts" by John Dore (1979), and 
the speech acts or individual utterances occurring within the event, Bru- 
ner has outlined a developmental sequence of first-year speech acts in 
child language acquisition: {\) dmand mode (cries), {2) request mode 
(cries with pauses for response), (3) exchange mode (reaching and vor, 
calizing for an object), and (4) reciprocal mode, in which mother and 
child take turns in a common activity and in which the mother provides 
the scaffolding or support to keep the reciprocal mode going. Speech 
event theorists in early language acquisition tend to describe C-acts as 
instances of sharing time, playhouse time, feeding time, and so forth. 

In summary, theories of social context have struggled with what the 
appropriate unit of analysis should be. Four units of analysis common in 
research on writing and classroom language are: (1) overall purpose 
and function, (2) different speech situations varying by role, status, and 
nationality. (3) the speech event, and (4) ihe speech act, 

Lexsons: Shifting Relationships among Writer- Reader-Subject-Text 

In the design of les.sons, Moffet and Britton have been influential in K- 
12 classrooms. Both have contributed to an interest among educators in 
a wide variety of writing assignments, Britton found that most class- 
rooms assigned only transactional writing and wriung directed to one 
audience — the teacher— and he recommended that school writing in- 
clude a variety of dif ferent types of audiences and functions, Moffett's 
1968 book on the K-12 curriculum introduced many teachers to a rich 
variety of writing purposes, moving many composition courses away 
from the limitations of the mode approach. 

Topic and Test Conditions 

If a writing topic is organized around a particular purpose, then the 
topic instructions should make that purpose clear. Some topics of the Na- 
tional Assessment of Educational Progress (NAEP) have been criticized 
for not alerting the writer to the purposes specified in the primary trait 
scoring guide; for example, Davis, Scriven, and Thomas (I981, 40) point 
out that ''the scoring key for a National Assessment of Educational Prog- 
ress writing test , , , required the student to write about a color picture 
of a stag swimming across a river in a burning forest. The key made 
clear that descrif)ing what was there (i,e,, doing what was requested) was 
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completely unsatisfactory; one could only get an A by inventing some 
fanciful background story, something which was not requested," 

A second problem in the design of topics and test conditions is the va- 
lidity of the identified purposes (Davis, Scriven, and Thomas 1981, 38): 

The value of writing for almost everyone lies only in its use for 
other, usually practical purposes and hence that is the only context 
in which it can be validly tested. Of course, teachers who believe the 
contrary will want to test their success in their self-appointed task 
(e.g., 'Creative writing"), but such tests are not valid tests of the 
composition skills that demonstrably need to be learned by all, the 
basic skill for which the taxpayer pays taxes. Tests of that or those 
basic skills must relate to their use on a task of independent validity. 
. . . In the school context there are dozens of such tasks widi con- 
current validity, e.g., writing up the report on a science project. 

Not everyone would agree with Davis, Scriven, and Thomas that 
storytelling has limited task validity outside of some writing classes. 
Flower, Hayes, and Swarts have suggested that technical writers use the 
"scenario principle," a form of narradve or storytelling, in order to 
"make meaning concrete enough to h^fujictional for the reader" (1980, 
19). Furthermore, although reports are common in many different sub- 
ject areas, particular types of reports, such as science projects, may not 
be taught to all students. 

Another problem in topic construcdon is that a topic attempdng to sit- 
uate a writing task in a school subject matter that all students are as- 
sumed to know may be at odds with the writing program in which 
students have been taught. In an effort to focus only on writing, separate 
from logic and grammar and other knowledge, many writing teachers 
promote writing tasks requiring no particular content — "Tell a story," or 
"Pretend you are a tennis shoe." Thus, many writing classes almost never 
situate wriung in a school subject matter. This tendency can be seen in 
NAEP's emphasis on expressive purposes and topics over other types — 
three out of five in the 1979 assessment for seventeen-year-olds. 

If primary-trait scoring is to be used, then the topic, topic instruc- 
tions, and scoring guide should be structured at the same time. The 
more structured the task, the more reliable the scoring. All scoring sys- 
tems assume that different writing tasks may have to be judged by dif- 
ferent sets of features. In holistic scoring and in Diederich's analydc 
scale, the features are defined impressionistically by the anchor papers 
selected from the population of writing samples. In Lloyd-Jones's pri- 
mary-trait .scoring, in addition to anchor papers, the features are de- 
fined explicitly by a scoring guide that oudines primary and secondary 
traits, all organized around a specified identity for the writer and an- 
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dience and a specified subject matter. In practice, particularly for ex- 
perienced readers, primary-trait scoring and holistic scoring do not 
differ very much, perhaps not at all. In both cases, the anchor papers 
tend to center and stabilize the scoring, providing the definition for the 
listed trait. 

These problems of topic choice are closely related to the question of 
which unit of analysis is appropriate in a study of social context in writ- 
ing. Should the topic have a highly generalized purpose, or a specific 
purpose embedded in a particular subject matter? There are those who 
argue that "writing for a general purpose" is a school invention, possibly 
unrelated to the outside world. 

Coding and Patterns of Use of Purpose and Social Context 

The coding examples that follow have been used by teachers and/or re- 
searchers with some valuable results. The first scale is derived from 
John B. Carroll's study of the scaled responses of 8 expert judges of lit- 
erature to 150 passages of English prose (Carroll 1960, 285-90). From 
68 different dimensions of reader response to literature (Carroll called 
them qualities of literature), Carroll identified 6 needed to account for 
all of the ratings of the 8 experts: good-bad, personal-impersonal, or- 
narnented-plain, abstract-concrete, serious-humorous, and characteriz- 
ing-narrating. Teachers have adapted the Carroll scale (1960, 285-90) 
for analyzing functions and purposes in student stories and personal 
narratives which have already been scored. This scale is not to be used 
for initial scoring. The purpose of the scale is to identify some features 
of reader response and subject matter, presumably representing some 
conventions of purpose and function. The teacher can then see how 
these features interact with scores. 



Adapted Carroll Scale 

THK PURPOSi:: > 

+ 3 +2 +1 0 
neutral 

c;oc)i) 

PERSO.VAL 

ORN.WIKNTEU 

AB.srRAcrr 

SERIOUS 

CHARACTERIZING 

+ 3 +2 +1 0 
neutral 



-1 -2 -3 

BAD 

IMPERSONAL 

PLAIN 

CONCRET E 

MTMOROU.S 

NARRAIINC 

-1 -2 -3 
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A 



B 



C 



D 



E 



F 



(k)od Personal Ornamented Abstract Serious Characterizing 



Bad Impersonal Plain Concrete Humorous Narrating 

Figure 9. Stvle profiles of two prose passages: ( ) a selection from K Scott Fitz- 
gerald's A Diamond as Big as the Riiz; ( ) a selection from Mickey Spillane's Vengeance 

Is Mine. 

The results for each dimension should be reported separately. Car- 
roll (1960, 291) reported the results in figure 9 when this scale was ap- 
plied to short stories by Fitzgerald and Spillane. 

A second scale, from the work of Lloyd-Jones (1977), provides for a 
ranking of primary and secondary traits based on purposes specified in 
the topic. The scale will often change for each topic. The next two ex- 
amples of topics and scales come from the National Assessment of Ed- 
ucational Progress. It is recommended that when teachers prepare their 
own scales, they change the scoring scale so that low numbers reflect in- 
adequate performance and that 0 and 00 be used for uncodable 
responses. 

NAEP's. ranking of primary traits is usually on a l-to-4 scale. Each 
rank is described by a general feature and sometimes by additional elab- 
oration of the topic. In one expressive topic, sUidents were asked to tell 
a story about a stork. The scoring of this trait on a 4-point scale ranged 
from "no evidence of story telling" (1) and "some evidence of story tell- 



(neutral) 
0 




2 - 
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ing" (2) to **cle;ii evidence of story telling" (3) and '\striictured and com- 
plete story telling" (4), '1 he trait itself \s Ixised on what is emphasized in 
topic instructions. For example, in one expressive topic, papers were 
ranked on how well the writer expressed ^'feeling through elaboration of 
a role," the role in this case [)eing one in which the writers were asted to 
pretend that they were a pair of tennis shoes. Persuasive and explanatory 
topics have quite different traits. One scale for a persuasive topic ranged 
from '*does not define and defend a point of view" (1) to ''does system- 
adcally define and defend a point of view" (4), 

An example of topic elaboration in the ranking scale is the scale based 
on the actual suiyect matter of the writing situation. The scoring fo- 
cused on the "presence and accuracy of the information given," at one 
point on the scale giving the writer credit for idejitifying the account 
number and mentioning the date and receipt of a ccllection letter. Many 
teachers have foun(l that this kind of scale is always necessary for scoring 
letters because teachers often have quite different notions about which 
parts are essential and which nonessential to letter form. For example, 
the argument has been made that the account number expresses audi- 
ence awareness, enablirig the reader to find the writer's account. Others 
argue that the full name is an adequate expression of th^ company's 
i(lenti[icati()n needs. 

A complete example of a scoring guide and its results is shown below. 
This scoring guide and its results were the fbllow-up to a topic asking 
young writers to tel( a storv af)()ut events in a photograph (adapted from 
Mullis 1975, 18-19, 1(3): 

Scoring Guide: Primary Trait 

(Categories are listed below, 
E)U?^' into World of Picture 

0 ■= NO RKSPONSK, NO I TR rHKR SCORINC, 

1 = NO I'.N I RV !N rO I UK 1^IA(;INAR^' WORLD OK WW. PICM RK: 

Rosporulents write about chiklren, the boat, or about any- 
thing else to do with the picture. However, there is only a 
single statenicnt or the information is too disjointed to make 
a f)()int: random details, bits of information, or lists of o!> 
servations that do not create a situation. Also includes pure 
description, papers that report o ily what's in the photo- 
graph or picture, 

1 — KN rR^• INK) nil-, imacwnarn' worij) of riiK picm rI'.: Re- 
spondents have accepted the world (jf the picture. However, 
tne control and consistency necessary to create a structured 
f)resentation are lacking. Of ten there is no structure to the 
work! of the picture. This is eviclenced bv few internal tran- 
sitions and details that don't harnioni/e. The ideas may be 
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related, but don't make a whole. L.ack of consistency and 
transitions result in little logical progression of ideas. On 
the other hand, these papers may have structure, hut the 
narrative is not workecl out. l*herc is little imagination on 
the part of the writer to create the story. An attitude may be 
stated, but it's not illustrated. You do not "feel" a mood has 
hi 1 created. Other papers may have some structure and 
the outline of a story or the hint of a mood, yet neither is 
developed. Generally ''2" papers are either undeveloped or 
developed in a helter-.skelter or confusing manner. 

3 = (;c)()i) KM RV IN ro riiK imachnary world oi- the Fie- 

ri' rk: Papers are generally competent. Respondents evi- 
dence the control and consistency to create a structured 
presentation. Often there are strong topic sentences and 
good transitions. However, the good quality of the papers is 
marred by development that is skeletal or somewhat uneven. 
Narratives display imagination, but often are left with gaps 
or other unevenness. Details may be inadequate, excessive, 
or unclear. Attitudes may be stated and somewhat sup- 
ported, but necessarily presented to "help your friend feel." 
A dehnite mood is not created. The underdeveloped paper 
has a definite beginning and end yet there is not enough 
material to fill out the structure or it is contrived. The un- 
evenly developed papers eidier have excessive details or the 
structure is oddly filled out. 

4 = I-MO riVK AM) CONSIS I KN r 1:n I RV IN lO I Ht. liMACJINARY 

WORM) t)i" HIE PiciL'Rt:: These papers are structurally 
-^vhole. Loose ends have been tied up or cut off (although a 
strong paper without closure can be rated in this category). 
Papers are consistent. Narratives are well- and evenly devel- 
oped or attitudes are expres.sed so a defmite mood is cre- 
ated. You do "feel" the experience. The structure is imified 
and supported by imaginative and evocative details. 

7 = II,l,K(;iBL,K, Il.l.I lKR.VrF.. NO FfRTHKR SCORINCi. 

8 = MISUNDERSTANDS THE TASK OR WRITES ON A TO! ALLY DIF- 

FERENT SUBJECT. NO FURTHER SCORINC;. 

9 = I i KNOW. NO FURl HERSCORlNCi. 



Story tries to reproduce the fantasy games of children, such as pre- 
tending to be pirates, shipwrecked, or riding whales. Stating the 
fantasy is not enough; two or more unelaborated fantasy sitviations, 
or a fantasy situation with at least one elaboration, must be present. 
Descriptions of games, for example, "follow the leader" or "king of 
the hill," are not included. Fantasy is more than a literal and logical 
explanation of the picture. 

1 = FAN l ASY IS FRKSEN I . 

2 - FAN'I'A.SY IS NO I PRESEN I . 



Fantasy 
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Insights 

Story develops insights into the writer's pei\spective on his oi* her hfe 
or liie in generuL The message should be integral to the story — not 
tacked-on jteiitiment. The genx-rali/utions or social eoininemaries 
can be stated implicitly as well as explicitly. Themes avc often based 
on positive or negative value statements about childhood or adiilt- 
hoocL Reminiscence ("1 remember when . . is not enough; some 
meaningf ul or intelligent statement must be implied. 

1 = INSlCili I S ARK PRKSKN r. 

2 = INSUan s ARl- PRl'Sl-N I . 

Results 



Primun Ira it: 
Entn into the Imagina)^ World oj the Picture 





I 2 


3 4 


.-life y 




lO^r <i9( 








Age 1 7 


i()9f' 


449; l{)9f 




Used Fantasy 


Included Insights 


Age 9 






Age n 


n)9f 


V'A 


Age 1 7 


2:^9f 





Another example of primary-trait results is the scoring results for the 
"principal letter" exeirise (NAKP 1980, 32) on page 100, the scoring of 
which is shown in table 8. The writing samples were scored on a 4-poinl 
scale, from papers which did not define and defend to the papers which 
systematically did. 

Table 8 

Percentages of 13-Year-Olds at Each 
Primary Trait Score Level, "Principal Letter" 
Exercise, 1973, 1978t 

\ear Score Point 





AW/i- 


Do Xot iMininial 


Define 


System- 


Margin- 


(Unnfie- 




rate- 


Define Define 


and 


atic 


al or 


tent or 




able 


and and 


Defnid 


Define 


Better 


Better 






Defend Defend 




and 














Defied 








0 


1 2 


3 


4 


2,3&4 


3 & 4 


197:^ (n = 2,352) 


2.99^ 


28.()',i M).17c 


2:).29{ 






28.49? 


1978 (n = 2,793) 


2.3 


33.5 43.7 


18.5 


1.8 


{)4.() 


20.3 


(Change 














1973-78 


- O.f) 


r).(r»' 2.9 


-().7* 


- 1.4* 


-5,1* 


-8.1* 



'^Statistically significant at the J) 5 ImL 

f Percentages may not total due to rounding error. 
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"Principal Letter" Exercise 

Imagine that your principal asked tor suggestions about how to 
make things better in your school Write a letter to your principal 
telling just ONE thing you think should be changed, how to bring 
about the change, and how the school will be improved by it. Space 
is provided below and on the next three pages. Sign your letter 
"C.hris Johnson," 

333 West Street 
Loden, Ohio 99999 
September 5, 1978 

Mary Hopkins, Principal 
Mil r tin Intermediate School 
Loden, Ohio 99999 



Another scale combines some of the specif .city of primary-trait scor- 
ing with parts of the Diederich scale and adds a rating of rater interest. 
This scale comes from the International Association for the Evaluation 
of Educational Achievement (1983): 



Sample Scoring Sheet 
Task 5 — Personal Story 

Population Student Rater 

With Respect to W'nter's Choice 
of Aim and Readership 
1 n adeq u a t e Exce 1 len t 
_J 2 3 4 5_. 

Qiiality and Scope of Content 

L Thematic appropriateness of 

what is said 

2. Presentation of characters, 

events, and feeling 

Organization and Presentation 

of Content 

3. Over-all narrative structure 

4. Appropriateness and control of 

detail : : 

Style and Tone 

5. Choice and consistency of tone 

6. Choice of words and phrases, 
sentence structures, and larger 

units of discourse 
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Grammatical features 

Spelling a mi o rtli ogra ph ic com 'enlio ns 

Ha ndwriting a n d nea t ncss 

Response ofRatrr Low Medium High 

7. My interest in the composition is 

8. My sense of connection with the 

writer as a person is 

Sample Scoring Sheet 
Task 6 — Argumentative/Persuasive Composition 
Population Student Rater 

With Respect to Writer's Choice 

o] A im and Readership 
I n adeq u a te Excelle n t 



12 3 4 5 



Qiiality and Scope of Content 




L Significance of what is said 




2. Argumentation/Exposition 




Organization and Presentation 




oj Content 




3, Organization of the whole text 




4, Organization of sub-units 




Style and Tone 




5, C.hoice and consistency of tone 




6. Choice of words and phrases. 




sentence structures, and larger 




u n i ts of d is cou rs e 




Grammatical features 




Spelling and orthographic conventions 




Hajidwriting and neatness 





Response of Rater Low Medium High 

7. My interest in the composition is 

8. My sense of being persuaded by 

the composition 



A quite different index of social context attempts to estimate the de- 
gree to which various words and phrases in the writing sample are sig- 
naling particular social relationships between writer and audience 
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(distancing), writer and subject (processing), and writer and text (mod- 
eling). Conversational distancing is close, and pmmtational far; conver- 
sational processing projects an approximate world, presentational a 
normative and hierarchical world; and conversational modeling indi- 
cates a transitory text, presentational a permanent text, The Ibrmala 
and some results (adapted from Myers 1982, 66-67, 140, 135) are shown 
below and in tables 9 and 10. See Myers (1982) For other examples of 
ux)rds and phrases indexing particular relalion.ships. 

Speech Event Scale 

Cunvirsational Distancing {Close Distancing): 
You (us, ours) + me (my, uiiiic) 
+ / comments (J thinks f believe) + One-time orieiuations 
= (I WVL writing about) 

*lbtal Worcfs 
Presentational Distancing (Far Distancing): 

Distant .sentence .subjects (noun.s) Opening sentence witliout 
+ nne information marker (A) + \^ ^ly^ YO^i 

-lotal Words subject position 

Convirsational Processing {Approximate Pt ocessing): 
and, (Init, or) + hedges (sorta) + leaps (really, a lot) 

Total Words 

Present a tion a I P rocessi }ig ( \o rniatii 'e a n d E m bed ded P rocessnig) : 
em beddings (if \ leho, hoieei'er) + ing modifiers 
+ qualifications (in getunvL perhaps) 

Ibtal Words 
Conversa tional Modeling ( Ira nsiton Modeling) : 
Punctuation Mark (!, CAPS, underlining) 

/ + slang (gotcha) + (>"t^-t»"i^^ ^^"^hng 

rriieKnd) 

Ibtal Words 
Presimtational Modeling (Permanent Modeling): 

Title + a statement marked as a concliusion at the end 



Table 9 

Analysis of Presentational Markers 
in Essays from 1980 to 1981 



(^om[)ined 












I (low) 


44 


1.4558 


.7602 


.1146 


1.22^7 to 1. 6869 


2 


78 


3.38:^ 1 


2.5855 


.2927 


2.8001 . 3.9660 




()') 


3.9951 


1.8188 


.2256 


3.5445 to 4.4458 


4 (high) 


40 


8.2515 


4.3343 


.6853 


6.8653 to 9.6377 




227 


4.0426 


3.3399 


.2217 


3.6058 to 4.4794 



In the conibiiicd data for essavs. the following pairs orgrou|)s sliow siirnifi- 
rant (iiiieronces in the [Vecjuency of presentational markei s: 1-3, l- K 
2-4, and 3-1 (at the p < .05 level or hovond). 



104 



Social Context 



103 



Table 10 

Analysis of Conversational Markers in Essays 
from 1980 and 1981 



Combined 












Group 1 


44 


,5073 


,5582 


.0842 


.3376 to .6770 


Group 2 


78 


*.5166 


.9486 


.1074 


.3027 to .7305 


Group 3 


65 


.3182 


.3672 


.0455 


.2272 to .4092 


Group 4 


40 


* 1534 


.1786 


.0282 


.0963 to .2105 


I'OrAL 


227 


.3940 


.6551 


.0435 


.3083 to .4797 



*Ciioup I = Low; Ciroup 4 = High 

*l1ie tw) groups showing a significant difference in the con^bined essays are 
group.s 2 and 4 (at the p < .05 level or beyond). 



Because the study of social context is still relatively new and research ap- 
proaches vary widely, few trends in student practices can be reported. 
However, one interesting pattern is the variation of different countries 
on the scale of Takala, Purves, and Buckmaster (1982, 119): 



Factor 

Personal Ornamental Abstract Single Logical 



Country 



Australia 


High 


High 


Low 


JHligh 


Low 


England 


Medium 


Low- 


Low 


Low 


Low 


Federal Republic 


High 


Low 


Low 


Low 


Low 


of (Germany 












Finland 


Low 


Low 


Low 


Low 


Low 


Israel 


High 


Medium 


Low 


High 


High 


Italy 


High 


High 


High 


High 


High 


Ivory CA)ast 


Medium 


Low 


Low 


Low 


Low- 


Japan 


High 


Low 


High 


High 


Medium 


Netherlands 


High 


Low 


Low 


Low 


Low 


New Zealand 


Low 


Low 


Medium 


Low- 


Low- 


Nigeria 


Low 


Low 


Low 


Low 


Low 


Scotland 


Low 


Low 


Low 


Low 


Low 


Thailand 


High 


High 


Medium 


Medium 


Low 


United States 


Low 


Low 


Low 


Medium 


High 



Suggested Studies 

L Can the social context of the writing class be altered so as to im- 
prove writing? To approach this question, the teacher-researcher 
needs some assumptions about what "improve" means and a hy- 
pothesis about how to alter the class. Miriam Ylvisaker (1979), a 
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teacher-researcher iVoni the Bay Area Writing Project, ap- 
proached this question with the assumption that "improvement" 
meant increased fluency, or more writing, and with the hypothesis 
that her high school class in Oakland, California, could be altered 
to provide for more peer response to student writing, Joan Duvall- 
Flynn, a teacher-researcher from West (Chester, Pennsylvania, ap- 
proached this question with the assumption that ''improvement" 
meant such things as ''more story words" and better structuring 
of events" and with the hypothesis that a Hfth-grade class could be 
altered to provide a productive setting for four boys who were 
behind. 

2. Melissa Davison (1979), a teacher-researcher from the credential 
program of the Bay Area Writing Pr()ject, decided to examine the 
influence of social context on student writing by studying how 
changing the audience changed the language the students used in 
their writing. 
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Other approaches to studying student writing and writing classes in- 
clude the examination of (1) the teaching of the conventions of standard 
English, as reflected in the ^'errors" in the writing samples; (2) student 
attitudes toward writing and various teaching approaches; and (3) the 
variety of approaches to the teaching of writing. All three features have 
persistent and serious problems of coding and interpretation. Neverthe- 
less, school districts in their assessments often focus on one or more of 
these features. 

1 Feature: "Errors" 

Theory: Errors and Expectations 

There are those who still insist that a concern about errors in school 
writing is the result of one social class's trying to exploit another Among 
those concerned about errors in school writing, however, the general 
view is that language is a habitual code, not necessarily a logical one, and 
that students who do not have control over the dominant code face se- 
rious communication difficulties when they venture into the world of 
colleges and commerce (Shaughnessy 1977). 

The study of errors in writing has undergone a radical change in its 
theoretical assumptions during the last twenty years, especially because 
of a growing interest of the public schools in educating students who had 
formerly been pushed out or kept out. As part of the War on Poverty in 
the 1960s, the dropout from secondary classrooms became a problem 
for the schools to solve rather than a status symbol, and at the same time 
public colleges and universities began attempting to educate the stu- 
dents entering under new open-admissions policies. The change in the- 
oretical assumptions was reflected in the names given the courses for 
students with many errors in their writing. These new courses were at 
first called "bonehead" English, then ''remedial" English, and later 
"English for the disadvantaged." The current term is *'basic writing" 
(Bartholomae 1980; Shaughnessy 1976). 
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Some of the present assuniptious about "errors'' are that written lan- 
guage is in nianv ways a second language, recjuiring for its teaching 
some of the techniques of foreign language instruction (Allen 1970); 
that well-educated adults have at least three '^dialects" available to them 
for writing — unplanned, planned for narratives and descriptions, and 
planned for exposition (Krashen 1978); and that students who are not 
so well educated have basic writinj;, a type of writing which these writers 
use as an occasion to acquire or learn the other types or "dialects" ol 
writing. Rasic writing, then, represents stages of acciuisiticMi or learning, 
not failure or arrested development (Bartholoniae 1980). 

In the second-language model, nattu'al acciuisition aiul learning are 
the two ways that adults internalize the rules for a second language, ac- 
cording to Krashen 's monitor model (1978), Accjuisitiori is the natural 
way, similar to language acquisition among chikh'en, and results in a feel 
for the "correctness" of acquired rules. Learning is the internalization 
of rules througii conscious knowledge and results in know^ing a few 
rules. Accjuisition is far more important to the language user. It is the 
acciuirecl language system that has most of the rules embedded in a feel 
for "correctness" and that initiates the sentence. The learned language 
.system can only operate on the output of the ac(|uired system and can 
only store the simplest rule.s— "It is difficult to carry complex rules 
around as mental baggage," says Krashen (1978, 176). The learned lan- 
guage .system, then, acts as a monitor that students can use on what they 
have already written. Some students do everything by feel, having no use 
for the monitor system, and others are monitor cn'erusers, reluctant to 
speak unless they know the rule (Kra.shen 1978). 

The question of how to reduce errors in student writing is a compli- 
cated matter. First, the reduction of the incidence of an error may have 
negative effects on other aspects of a student's writing. For instance, the 
reduction of spelling mistakes may reduce fluency among writers who 
need to develop smooth motor routines in writing. Second, some errors 
are an indication of new improvements in writing devek)pment and 
should not be reduced prematurely For instance, errors in modification 
and nominalization can occur when students start to write more on ac- 
ademic subjects. 'leacher attention to these errors could force students 
to return to easier topics in order to protect themselves from criticism. 

Finally, errors may have different conceptual foundations rather than 
a common foundation. Shaughnessy (1977) has suggested that four 
grammatical concepts underlie most student misunderstandings about 
ibrm: (I) the sentence, particularly the base words of subject and pred- 
icate; (2) inflec^tion, particularly the way the concept works in dificrent 
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languages; (3) tense, recognizing that the point is to teach a verb system, 
not the experiential C()ncei)t of time; and (4) agreement. Shaughnessy 
uses many different devices for teaching these concepts, including sen- 
tence combining, the development of analogies, and focused drill. 

The leaching of rules alone seems to acbieve limited results in the re- 
duction of error Sherwin reports, '*It apj)ears that rules ofier limited 
help in the teaching of spelling" (19{)9, 10{)), and KIley et al. report that 
the direct effects of the study of transformational granuiiar on the lan- 
guage growth of secondary school pupils are "negligible" (197()), 

The grammar program in the Ellev study explained phrase structure 
and transformational rules, anci at the end of the course 94 percent of 
the students were largely correct in their analysis of sentences. After two 
vears of study, however, no diflerences a|)peare(l among students in the 
grammar program and two other programs. After three years, the stu- 
dents in the granunar program showed "small diiferences . . , in some 
minor conventions of usage" (Klley et al, 1976, 18), In his review of the 
literature, Sherwin came to a similar conclusion: "After a tally of pro- 
cedural and other limitations, the research still overwhelmingly sup- 
ports the contention that instruction in formal grammar is an ineffective 
and inefficient wav to help students achieve [)r()iiciencv in writing" 
(1969,168). 

Lessons: Usag(\ Punctuation, CapitaUzation, and Other Conventions 

From David Holbrook (19{)1) to Mina Shaughnes.sy (1977), a number of 
excellent teachers have given many useful examples of lessons which 
have worked with basic-writing students, that is, inspired the acquisition 
of greater profic iency. Most of these approaches emphasize situations in 
which rule-learning is a secondary, not a primary focus. 

Topic and Test Conditions 

Some topics and some conditions produce more errors in writing, the 
results varying not only by differences in students but by differences in 
the errors targeted for study Another issue is whether the errors are to 
be divided into perceptual errors and other types. Perceptual errors are 
"slips-of-the-eye" which arc corrected when the student rereads the pa- 
per, if these errors are to be eliminated from the .study, then time must 
be provided for students to reread papers. The method of rereading can 
also make a difference. Some students seem to perceive some errors only 
when they read the errors aloud. 
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Coding o/Enors 

The errors that should be coded are those which make a difference to 
leachers. Some errors are associated with second-language and dialect 
interference. For example, the following errors are among those associ- 
ated with a student using Spanish phonology in the writing of English 
(Moore and Marzano 1979, 161): 

1. Improper word order in main clause 

2. Improper pronoun (e.g. he tor you) 

3. Adjective used as noun 

4. .s ending on an adjective 

5. Improper agreement 

6. Omitted s for possessive form of noun 

7. Improper formation of irregular possessive pronoun (e.g. you 
for yaur) 

8. Improper word order with adverbs modifying \'erbs 

9. No auxiliary with negative and interrogation 

10. Use of present for past 

11. Use of present for present perfect 

12. Use of past for present 

13. Improper formation of past participle 

14. Contractions not fully developed (e.g. don for doyi't) 

15. Improper present participle ("I am ready for to read" for *i 
am ready for reading") 

16. Improper subject/verb concord of number 

17. Subject/verb word order reversed 

18. Third person subject not stated 

19. Double subject (The teacher, he is late) 

20. Omitted coordinate conjunction 

21. Omitted preposition (I live Main Street) 

The following are examples of spellings which have been identified as 
associated with black dialect (Groff 1978, 23): 



Standard spelling — Dialect related spelling 



1. 


side 


— sie, site 


13. 


hold 


— hode, hole 


2. 


rub 


llip 


14. 


hard 


— hod, har 


3. 


flat 


— flah,flad 


15. 


warm 


— warn 


4. 


cross 


— t raiv 


16. 


melt 


— vwi 


5. 


size 


— sie, sice 


17. 


fix 


— jisk, [is 


6. 


jar 


— ja/t 


18. 


these 


— desc 


7. 


bell 


— beh 


19. 


three 


— thee, tree 


8. 


game 


— ^tt^*, gane 


20. 


ten 


— tin, t(nn 


9. 


reading 


— readin 


21. 


best 


— hist 


10. 


mouth 


— mouf, mofut 


22. 


chair ; 


— chen 


11. 


fast 


— fas.fah 


23. 


poor 


— pore 


12. 


plant 


— plat, plan 


24. 


still 


— steel 



And the following spelling problems have been associated with de- 
veloping orthographic concepts in young children (Beers and Hender- 
son 1977, 137): 



Ho 
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Spelling Pattt 

Categoii 

Short vmveLs 
Short a as in cat 
L omission of a 

2. e substituted for a 

3. correct form begins to appear 
Short p as in met 

1. a substituted for e 

2. i substituted for e 

3. correct form 
Short i as in hit 
L substituted for i 

2, correct form 
Short 0 as in stop 
L i substituted for o 

2. u substituted for o 

3. occasionally correct form 
Short II as in up 

1 . i appears for u 

2. 0 for 

3. a appears for u 

ou as in xoould 

1 . u for 

2. occasionally correct 



Sequences 

Examples 



CT (cat), VSdast), HVE 
(having), SIP (slap), MTR 
(matter) 

THET (that), KREB (crab), 
EM (am), HED (hayid), 
HEPED (happened), CEM(ca7i) 



WAN (when), WAT (wwi/j, 
(;AT (get), CAP (Af^/^O, FAIT 
(/^'//;, STAFT (stepped), DRAS 

WlNTfimi/j, SL1DP:G 
(sledding), MODI, (metal). 



MB:S(m/A.v;, HEZ (his), 
DEFRET (different), SCEN 
fA/i/n;, LEST (list), CHECKS 
(chicks) 



GITN (g-otozj, TIP (top), 
GRASHIPR (grasshopper) 
STUPIG (stopping), SLUPE 
(sloppy), GR/\SHUPIR 
(grasshopper) 



]IM?ING (jumping), BINE 
(Ininny), INTILL (until), PITE 
(ptitty) 

THODER (thunder), 
CROSHD (criLshed), 
SNOGOVL (snuggle), SNOK 
(snuck) 

SADN (sudden), CRASHER 
(criLshei'), FANE (funny) 

SUD (.v/iaz^/* 
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The following is the list of* errors developed by the National Assess- 
ment of Educational Progress in its study of errors in papers by seven- 
teen-year-olds: 

L Sentence l.evel Mechanics Categories 

A. Sentence Types with Punctuation Errors (sentences that do not 
fall into any of the syntax categories), 

L Run-on Sentence 

a. Fused — A sentence containing two or more independent 
clauses with no punctuation or conjunction separating 
them. 

b. On and on — A sentence consisting of four or more inde- 
pendi'nt clauses strung together with conjunctions, 

c. C'onima splice — A ,sentence containing two or more inde- 
pendent clauses separated by a comma instead of a semi- 
colon or a coordinating conjunction, 

2. Incorrect Fragment — A word group, other than an indepen- 
dent clause, written and punctuated as a sentence, 
N'OTE: l*he scoring of I'-unit constituents made it possible for .some 
of the preceding sentence types to be derived through data analysis 
for the "Rainy Day" papers. 

B. Faulty Sentence Construction (These .scores are in addition to the 
sentence types.) 

1 . Agi'eement Error — A sentence where at least one of the follow- 
ing is present: subject/verb do not agree, pronoun/antecedent 
do i\ot agree, noun/modifier do not agree, subject/object 
pronoun misused, and/or verb tense shifts. 

2. Awkivard Sentence (The awkward categories arc listed in order 
of category precedence, since only one score was given to a 
sentence.) 

a. Faulty parallelism — A parallel construct ion tha' is se- 
manticallv or structurally dysf unctional. 

b. Unclear pronoun reference — A pronoun's antecedent is 
unclear. 

c. Illogical construction — Faulty modihcation or a dangling 
modifier or a functionally misarranged or mispropor- 
tioned sentence. 

d. Other dysfunctions — A sentence containing an omitted or 
extra word and/or a split construction that definitely de- 
tracts from readability. 

II. Punctuation Errors — Every error of commission and error of omis- 
sion is scored for commas, dashes, cj notation marks, semicolons, 
apostrophes, and end marks. I'he most informal rules of usage are 
used with the writer receiving the beneht of any doubt. 
III. Word- Level Mechanics Categories 

A. Word Choice — The writer needs a word that is different from the 
one written. This category also includes attempts at a verb, ad- 
jective, or adverb form that is nonexistent or unacc:eptable. 

B. Spelling — In addition to a misspelling, this category includes 
word division errors at the end of a line, two ^volxls written as one, 
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one word written as two, superfluous plurals, and groups of dis- 
tinguishable letters that do not make a legitimate word. 
C (capitalization — A word is givcii a capitalization error score if the 
first word in a sentence is not capitalized, if a proper noun or ad- 
jective within a sentence is not capitalized, and if the pronoun "I" 
is not capitalized. 

Patterns of Use 

After the coding and error counts are completed, the investigator must 
decide what the baseline will be in order to report results. Table 11 
(adapted from NAEP 1980, 46) uses a combination of percentages 
(What percentage of all sentences in the group were fragments?) and 
numbers (What was the average number of capitalization errors on pa- 
pers in the group?). The mean is the average for all groups of seventeen- 
year-olds in the nauonal sample, the median is the point which 50 per- 
cent of the students are above and 50 percent below, the first quartile 
represents the point w^hich 25 percent of the students were above and 75 
percent below, the third quartile represents the point which 75 percent 
of the students are above and 25 percent below, and the 90th percentile 
represents the 10 percent of the students who are the most error-prone. 
Notice that the patterns of error vary from one kind of writing to 
another 

2 Feature: Student Attitudes 

Theo)y: Personality Studies 

One of the ways that teaching practices are assessed is an examination 
of the responses of the students. One theoredcal framework in which 
such assessments are done is provided by the work of Carl Rogers (1951) 
and Abraham Maslow (1954), For Rogers, successful teaching enables 
students to become congruent personalities. The total personality has 
two domains, one of self-structure and the other of experience. When 
self-structure includes surrounding experience, the personality is con- 
gruent. For example, if a student regarcLs the writing assignments in a 
wriung class as threatening and demeaning, then the wridng class is not 
facilitadng the student's development as a congruent personality 

For Maslow, development into a congruent personality occurs in 
stages, each stage focused on salient needs and each stage leading to a 
higher level of human modvation. The first stage begins with basic phys- 
iological needs such as food and drink and leads to a need for security, 
order, and protection in the .second stage. In the third stage, the salient 
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Table 11 



Means and Percentiles for Errors in Narrative and Descriptive Papers, Age 17, 1969, 1974, 1979t 

1969 1974 1979 

Mean Q/ Median Q3 90th Mean Ql Median Q3 90th Mean Ql Median Q3 90th 



Narrative ("Stork") 



% sentence fragments 


1 


0 


0 


0 


{) 


2 


0 


0 


0 


9 


2 


0 


0 


0 


8 


vc run -on sentpnrps 




0 


0 


0 


17 


6 


0 


0 


6 


20 


5 


0 


0 


() 


17 


% awkward sentences 


14 


0 


12 


25 


40 


15 


0 


1 1 


25 


40 


15 


0 


1 1 


23 


40 


# capitalization errors 


1 


0 


0 


1 


2 


1 


0 


0 


I 


2 


1 


0 


0 


1 


2 


% misspelled words 


2 


0 


1 


3 


5 


2 


1 


2 


4 


6 


2 


1 


2 


3 


6 


% word-choice errors 


1 


0 


0 


1 


2 


1 


0 


0 


1 


3 


1 


0 


0 


1 


2 


% sentences with agreement errors 


2 


0 


0 


0 


9 


3 


0 


0 


0 


1 1 


2 


0 


0 


0 


11 


# total punctuation errors 


6 


2 


4 


8 


13 


6 


2 


5 


8 


15 


() 


3 


5 


8 


13 


Number of respondents 






365 








417 










538 


















Descriptive 


("Describe") 












% sentence fragments 


4 


0 


0 


0 


14 


5 


0 


0 


6 


20 


4 


0 


0 


0 


14 


% run-on sentences 


7 


0 


0 


10 


25 


10 


0 


0 


11 


38 


7 


0 


0 


12 


33 


% awkward sentences 


16 


0 


11 


25 


43 


18 


0 


13 


25 


43 


19 


0 


15 


29 


50 


# capitalization errors 


0 


0 


0 


0 


1 


1 


0 


0 


1 


2 


1 


0 


0 


1 


2 


% misspelled words 


3 


1 


2 


3 


6 


3 


1 


2 


4 


7 


3 


1 


2 


5 


8 


% word-choice errors 


1 


0 


0 


1 




I 


0 


0 


1 


2 


1 


0 


0 


1 


2 


7c sentences with agreement errors 


7 


0 


0 


1 1 


25 


9 


0 


0 


12 


29 


8 


0 


0 


13 


25 


9? total punctuation errors 


2 


1 


2 


4 


5 


3 


1 


2 


4 


() 


3 


1 


3 


4 


7 



Number of respondents 365 417 538 



tStatistically significant at the A) 5 lei^ei 

Fii ^ leans and perrenliles have been rounded to the nearest whole nnmben 
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need is social, a desire for "belongingness," and in the fourth stage the 
need is for self-esteem, prestige, and status. Finally, in the fifth stage, 
human beings become self-actualizing. Maslow studied self-actualizing 
persons in history and contemporary society and found that they were 
more efficient in perceiving reality, more accepting of themselves, more 
spontaneous, more able to center on problems and their solutions, and 
more able to resolve moral dichotomies and their dilemmas. For Maslow, 
a successful v/riting class would contribute toward student growth 
through this hierarchy of motivations. For writing researchers, the issue 
becomes the study of the effects of writing apprehension on students 
and possible treatments for anxious students (Daly and Miller 1975, 
248). 

Lessons: Increasing Self-Esteem and Facilitating Pmonality Growth 

A number of teachers have used the theories of Maslow and Rogers in 
the design of lessons for the classroom. Several examples can be found 
in Building Self-Esteein through the Writing Process by Lynn Howgate and 
in If Maslow Taught Writing by Ada Hill and Beth Boone. Hill and Boone 
provide examples of ways to help students at different levels in Maslow's 
hierarchy. 

Topic and Test Conditions 

If questionnaires are used, then students must be encouraged to give 
accurate and complete responses. Without encouragement, students 
tend toward incomplete and inaccurate responses. 

Coding and Patterns of Use 

Hill and Boone have suggested giving students the two scales on pages 
114 and 115 (1982, 17-- 18) and having students place X's over the five 
"gripes" and "why-writes" that most closely express their attitudes. 

Hill and Boone have arranged these scales to represent different lev- 
els in Maslow's hierarchy of growth. For gripes, they used the following 
scoring (1982, 16-19): 

The diagonal row of boxes from the upper left corner to the 
lower right corner (numbers 1, 7, 13, 19, and 25) are responses that 
indicate a strong need for belonging, sharing, and peer support. 

The triangle to the left of that diagonal contains both basic and 
safety level gripes (basic-numbers 6, 12, 18, 22, and 24; safety num- 
bers 11, 16, 17, 21, and 23). 

The triangle on the right of the diagonal has complaints vocal- 
ized as a result of the need for ego reward and the need to self-ac- 
tualize (ego-numbers 2, 4, 8, 14, and 21 ; self-actualization-numbers 
3,5,9, 10, and 15). 
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Writing Gripes 



I 

\i I'm going to write, it 
lias to l)e .soinctliiiig that 
will be read and 
answered, like a note or a 
letter. 


'_)^ 

Writing makes nie feel 
had,l put lots of work 
into a paper and all 1 gel 
is a grade. 


3, 

I wouldn't mind writing 
if I got to write the 
things I want to write. 


4, 

It's dumb to write for a 
class. Real writing, for a 
newspaper or a 
magazine, would be 
better. 


5. 

Why siiould I write only 
what my teacher tells me 
to write." I want to create 
a story or a poem. 


(), 

I never have paper or a 
pen, n teachers want me 
to write, thev must give 
me the things I need. 


7. 

If we could work in 
groups and write 
together. I'd like to write, 
I d(Mi't like to sit by 
myself and write. 


8, 

The thing that makes me 
mad is I have to write 
and no one sees it except 
my teacher. I want others 
to see what I can do. 


9, 

I like to write when I 
choose to, but I hate to 
write at seiiool or on 
.school assignments. 


10, 

I like to write. In fact, I 
get ,so involved that I am 
lost in my writing, but at 
school, I'm not allowed to 
get that involved. 


11. 

I don't like to write 
because no one will help 
me start. 


V2. 

How can anyone be 
expe( ted to write in a 
classroom? It's dirty, 
noisy, and crowded. 


B. 

Writing for a teacher is 
stupid, I want to share 
my ideas and writing 
with my friends. 


14. 

1(1 write more but no 
one appreciates it. \\\ 
rather spend my tune 
doing something 
worthwhile. 


In, 

Teachers are so unfair. 
They only aae[)t writing 
thev like and agree with. 


1(). 

*rhey tell me to use a 
dictionary and a 
grannnar book, but Vm 
not able to (ind t!ie right 
word or page. 


17. 

1 can't spell or 
punctuate. It would be 
better if I learned that 
liist, then I (ould write. 


18. 

'leathers want nie to use 
a dictionary. If I had 
one, I d use it. Why 
aren't there enough 
here? 


10. 

I don't like to write by 
myself, I need to be with 

't irrr^im fif I'^f'fil^lc f^J*i(ire 

I can do nu' best. 


20. 

Writing is useless. 1 need 
to spend my time doing 
something that lets 
j)eople really notice me. 


21. 

I (an't write il I don't 
know what to do. A 
It acher should show me 
how! 

L L% 


"leadiers sav thev (an't 
read mv liandwriting. It 
is silly to write if no one 
can read ii. 


2:^, 

I hate being told to write 
a composition about 
anvthing I choose. I want 
good directions and a 
good assignment. 


24. 

I can't write because I'm 
always too tired or 
hungry. 


25, 

I get mad when I have to 
be (|uiet. How can 1 write 
if I ( an't share my ideas 
with a friend first? 
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Why Write? 



K 

lo rc( ()i (I 

aiinoiiiK CiiicMits and 
iniiuucs for a ( lub or 
group you l)eloiit^ to. 


0 

lb enter writing contests. 


decisions about what vou 
ha\c read or heard. 


4. 

lb develop vourself as 
the kind of writer tliat 
you want to he. 


."). 

lb h.elp you find 
happiness expressing 
your tlioughts. 


l\ 

lb do as well as vour 
friends do in s( hooL 


7. 

lb express vour 
opinions, su( Ii as in a 
letter to an editor, 
iea( her, or j)rin( ipal. 


8. 

iKj f^ivt ii\e 

Speeches. 


lb keep tra( k of vour 
, thoughts and feelings in 
a diary or journaL 


10. 

lb improve your own 
writing stvlt\ 


11. 

pass writ ten 
assign int-nts given in 
(lass 


\± 

lb work with others on 
group projects and 
reports. 


"lb correspond with your 
family or friends to tell 
them what is happening 
to vou. 


1 i 

14. 

'lb present vour \ lews to 
otliers to ( onvince them 
that you are right. 


1.5. 

lb experiment with new- 
ways of expressing youi' 
ideas. 


Ml 
U). 

li) describe something, 
su( li as a party or an 
aaident. 


17. 

lb (opv vour favorite 
song Iyri( s, poems, 
savings, etc. 


18. 

"lb exj)lain to someone 
iiow to do or make 
something. 


H) . 

lb stiow diat vou can do 

I) etter work than others 
hi your class. 


lb see your nanie and 
works in print. 


2K 

lb take a message for 
someone. 


lb fill out forms. 


lb give directi(Jiis on 
how to get from one 
place to another. 


lb help soiiieone else 
with a problem. 


lb entertain other 
people. 
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For why-write, they used the following scoring (1982, 19): 

The boxes in the lower left-hand corner (numbers II, 16, 17, 21, 
22, and 23) represent the safety-level students' perceptions of the 
reasons for school-related writing. Students on the belonging-level 
most frequently respond to boxes 1, 6, 12, 18, 24, and 25. On the 
other hand, ego need-level students tend to mark boxes numbered 
2, 7, 8, 14, 19, and 20, and students on the self-actualizing-level most 
frequently respond to those numbered 3, 4, 5, 9, 10, and 15. The 
center box, number 13, could be labelled "free," since it is the one 
most often chosen by all level students. Notice that none of the boxes 
is normally chosen by students with truly basic needs. Basic-need 
students usually see no reason for writing at all. 

Both Hill and Boone provide numerous cautions about using such 
scales to diagnose individual student needs. However, they believe that 
such scales do provide interesting clues about some of the attitudes de- 
veloping in a writing class. 

Daly and Miller (1975, 245-46) report that the following scale has 
proven to be a reliable instrument for measuring writing apprehension 
(+ indicates writing apprehension; drop + and - when scale is used 
with students): 

Directions: Below are a series of statements about writing. There 
are no right or wrong answers to these statements. Please indicate 
the degree to which each statement applies to you by circling 
whether you (1) strongly agree, (2) agree, (3) are uncertain, 
(4) disagree, or (5) strongly disagree with the statement. While 
some of these statements may seem repetitious, take your time and 
try to be as honest as possible. Thank you for your cooperation in 
this matter. 

( + ) 1. I avoid writing 

( — ) 2.1 have no fear of my writing being evaluated 
( - ) 3.1 look forward to writing down my ideas 
( + ) 4. I am afraid of writing essays when I know they will be 
evaluated 

( + ) 5. Taking a composition course is a very frightening 
experience 

( - ) 6. Handing in a composition makes me feel good 
( + ) 7. My mind seems to go blank vvhen I start to work on a 
composition 

( + ) 8. Expressing ideas through writing seems to be a waste of 
time 

(-) 9. I would enjoy submitting my writing to magazines for 

evaluation and publication 
( — ) 10. I like to write my ideas down 

( - ) 11. I feel confident in my ability to clearly express my ideas in 
writing 

(-) 12. I like to have my friends read what I have written 
( + ) 13. I'm nervous about writing 
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( - ) 14. People seem to enjoy what I write 
(-) 15. I enjoy writing 

( + ) 16. I never seem to be able to clearly write down my ideas 
(-) 17. Writing is a lot of fun 

( + ) 18. I expect to do poorly in composition classes even before I 
enter them 

( — ) 19. I like seeing my thoughts on paper 

(-) 20. Discussing my writirr/ with others is an enjoyable 
experience 

( + ) 21. I have a terrible time organizing my ideas in a composition 
course 

( + ) 22. When I hand in a composition I know I'm going to do 
poorly 

( - ) 23. It's easy for me to write good compositions 
( + ) 24. I don't think I write as well as most other people 
( + ) 25. I don't like my compositions to be evaluated 
( + ) 26. I'm no good at writing 

Another instrument used to measure student attitudes is the student 
questionnaire used by the National Assessment of Educational Prog- 
ress, shown in table 12. 



Table 12 



National Percentages of Responses to Attitude 
Questions about Writing, Age 13, 1978 

On this ^nd on the next page are statements about writing. There 
are no right or wrong answers to these statements. Please indicate 
how much you agree or disagree with each statement by filling in 
the oval under the appropriate response. While some of the state- 
ments may seem repetitious, take your time and try to be honest as 
possible. 

~ S""* 



Agree Disagree 



A. 


I like to write 
down my ideas. 


12.9 44.3 
\ / 
57.2 


2LP 


16.2 4.7 
\ / 
20.9 


B. 


I am no good 


7.5 16.8 


21.7 


37.8 15.9 




at writing. 


\ / 




\ / 






24.4 




53.7 


C. 


Expressing ideas 
through writing 
seems to be a 
waste of time. 


6.3 11.9 
\ / 
18.3 


16.3 


39.9 25.3 
\ / 
65.1 
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Strongly Uncertain Strongly 

Agree Uncertain disagree 

Agree Disagree 



D. Peopleseemto 6.5 2L1 47.5 15.5 9,3 

enjoy whai I \ / \ / 

27.6 24,8 



write. 



I expect to do 

poorly in 4.7 12.4 20.8 41.1 20.7 

composition \ / • \ / 

classes before 17.1 61.9 

I take them. 



F. I look forward 10.3 33.6 22.5 23.7 9.7 
to writing down \ / \ / 
my ideas^ 43^9 33 .5 



G. I write for other 24.1 52.1 6.3 13.3 3.8 
reasons besides \ / \ / 

school. 76.3 17.2 



H. When I hand in a 3.3 9.0 24.4 43.9 18.7 
composition, I \ / \ / 
know I'm going 12.3 62.6 
to do poorly. 



19.7 39.1 18.2 14.8 7.6 
L I enjoy writing. \ / \ / 

58.9 22.4 



J. lamafraiJof 6.8 22.0 25.9 33.9 10.9 

writing essays \ / \ / 

when I know they 28.8 44.8 

will be evaluated. 



K. I feel confident 

in my ability to 14.5 38.2 25.1 16.6 5.3 
clearly express \ / \ / 
my ideas in 52.7 21.9 
w r i ting. 



5.1 9.6 8.9 42.7 33.4 

L. I avoid writine. 

14.8 76.1 



Percentages may not add to 100% due to nonrespoyise. Also, percentages for 
strongly agree and agree or disagree and strongly disagree may not add to 
total agreejdent or disagreement due to rounding. 

Percentage of Respondents Giving a Positive Response 
to 12 Attitude Questions 



At least 1 . 


97.9% 


At least 7 


56.8% 


At least 2 


94,5 


At least 8 


43.8 


At least 3 


89,5 


At least 9 


32.9 


At least 4 


83.5 


At least 10 


22.3 


At least 5 


75.9 


At least 11 


11.8 


At least 6 


67,2 


All 12 


4.8 
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3 Feature: Teaching Practices 

Theory: From Personality to Behavior to Subjects 

leaching theory is in such a sad state that those who do not teach K-12 
and who have never (or rarely) taught K-12 are allowed to assert that 
their intuitive claims about K-12 teaching are superior to the insights of 
those who do teach. 1 call the claims of those who do not teach K-12 "in- 
tuitive" because such researchers, by and large, use a narrow, restricted 
sample of classroom data to make claims about the whole K-12 class- 
room, a set of data which they have not collected and in most cases not 
even observed. Thus, even though the data these researchers collect are 
governed by research norms, the data they speculate about are based on 
little more than iatuition. 

The data these researchers collect have been an inadequate repre- 
sentation of K-12 classrooms because these researchers have almost al- 
ways focused on some single variable to the exclusion of everything else, 
whether teacher personality or teacher behavior, student behavior or 
subject content. Teacher per.sonality studies ended with Nate Ciage's 
conclusion that "these studies have yielded disappointing results" (1963. 
118). The next focus was on either teacher or student behavior — for ex- 
ample, frequency of teacher-student interaction (Flanders 1967) and the 
academic learning time or time-on-task of students (Berliner 1976). Fi- 
nally, some researchers turned to content and subject matter — for ex- 
ample, sequences of instruction in mastery learning (Bloom 1976) or the 
way teachers organized their subject matter (Schulman 1984). 

By focusing their attention on a limited number of variables, these re- 
searchers have had much to say of interest. The problem starts when 
these studies are presumed to legitimize mandates to teachers about 
how to teach in all classrooms. Research on teaching has generally ig- 
nored anything that could not be measured by an observation instru- 
ment. In fact, the major book reviewing research on teaching explicitly 
rejects studies that do not have instruments for quantifying data (Dun- 
kin and Biddle 1974, 3). As a result, studies of teaching have largely ig- 
nored the rich complexity of successful classrooms. For this reason and 
others, there are no adequate theories about teaching. In fact, one might 
say that studies of teaching have been generally atheoretical. One of the 
primary concerns of teachers is an adequate description of what brings 
about change in the classroom. The examples that follow are efforts in 
that direction. 

Coding Practices arid Patterns of Use 

Some surveys of teaching practice use student evaluations. Below are 
samples of the student evaluation form and the overall results from Mir- 
iam Ylvisaker's class at Oakland High School: 
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Evaluate your writing now as 
compared with the beginning of this 
class: 


Ability to organize ideas 

Ability to express feelings in 
writing 

Ability to get ideas for what you 
want to say 

Your knowledge of vocabulary 

Your knowledge of sentence 
structure 

Your knowledge of spelling 

Your over-all self-confidence about 
writing 


Le.ss 


Same 


Better 













































QU E ST ION N A I R E 

Evaluate your xvriting noxv as 
compared xvith the beginning of this 
course: 


Less 


Same 


Better 


Ability to organize ideas 




7 


17 


Ability to express feelings in 
writing 




(3 


16 


Ability to get ideas for what you 
want to say 




8 


14 


Your knowledge of vocabulary 




12 


9 


Your knowledge of sentence 
structure 




11 


10 


Your knowledge of spelling 




10 


11 


Your over-all self-confidence about 
writing 


1 


8 


14 


Evaluate this class 


Not at 
all 


Some- 
what 


Vfery 


Do you think making copies of 
students' writing is useful? 


3 


12 


10 


Do you think having students read 
aloud their writing is useful? 


1 


5 


18 


How much did you enjoy this class? 


1 


11 


10 


How useful do you consider this 
class? 




5 


15 
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Another sample of a survey of teaching practices is the questionnaire 
shown in table 13, given to seventeen-year-olds by NAEP (December 
1980, 48-49). 

Table 13 

Responses to Background Questions, 
Age 17, 1974, 1979t 



3. 



1974 


1979 


Change 


(n = 34,211) 


(71=26,631) 


1974-79 


How many reports written in last 6 weeks 




U3 jjul L \ji diiy cissii^nment. 






0 13.0% 


13.9% 


0.9% 


1 11.4 


12.3 


1.0 


2 16.3 


16^8 


0.4 


3 14.7 


14.0 


"0!6 


A 1 1 o 

^ 1 1 .2 


11.1 


-0.1 


5-10 25.7 


22.5 


-3.2 


More inan lu o.^ 


c o 
0.0 


-0.9 


Time spent in English class on 






instruction in writing? 






None of the time 5.0 


3.7 


-1.3* 


Little of the time 41.6 


33.7* 


-8.0* 


1/3 of the time 33.6 


31.7* 


3.5* 


1/2 of the time 13.8 


17.4* 


3.6* 


Most of the time 5.8 


6.9 


1.1 


A. Taken additional remedial 






writing course? 






Yes 6.3 


8.2 


1.9* 


B. Taken additional creative 






writing course? 






Yes 20.5 


24.6 


4.1* 


C. Taken other additional writing 






course? 






Yes 14.9 


16.6 


1.6 



Total have taken at least 
one additional course 
other than remedial 



26.1 



4, Encouraged to jot down ideas and 
take notes before writing? 
Usually 
Sometimes 
Never 



24.0 



54.4 
35.1 
7.7 



-2.1 
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5. Encouraged to create outlines? 

Usually 49,4 

Sometimes 35.5 

Never 11.2 

Encouraged to prewrite: notes or 

outlines or both 66-0 

Neither notes nor outlines 3 L2 

Either notes or outlines 28,3 

Both notes and outlines 37,7 

6. Do you draft papers more than 
once before turning in? 

Usually 53.9 56,3 2,4 

Sometimes 40,1 35,9 -4,2* 

Never 5,9 7,8 1.8* 

7. Does teacher write suggestions on 
paper? 

Usually 33,1 48,0 14,9* 

Sometimes 56,5 44,2 - 12,2* 

Never 10,4 7,7 -2,7* 

8. Does teacher discuss papers with 

YOU? 

Usually 27,0 

Sometimes 57,1 

Never 15.8 

Teacher feedback: written 
suggestions or discussion or both 57,9 
Neither written suggestions 

nor discussion 42, 1 
Either written suggestions or 

discussion 40,4 
Both written suggestions and 

discussion 17,5 

9. Do you work to improve papers 
after they are returned? 

Usually 13.4 

Sometimes 46.2 

Never 40,3 

10. Do you enjoy working on writing 
assignments? 

Usually 20.6 

Sometimes 55.3 

Never 24.1 

Summary of writing as a process: 
Prewrite, draft, feedback, improve 

None 10-4 
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At least one 
At least two 
At least three 
All four 



89.5 
670 
34.2 
6.7 



*Statistically significant at the .05 level. 
tPercentages may not total due to rounding error. 

Suggested Studies 

1. What are student attitudes toward writing? Alberta Grossman, a 
teacher-researcher from the Virginia Writing Project, ap- 
proached this question by keeping a journal on one student in 
class. Her journal includes the following entry (1982, 118): 

Mickey rereads what he has written, biting his pen tip, think- 
ing. Then looks at his notes and writes again, I am writing too. 
trying to keep myself from being involved unless I am asked. 
Mickey has "gotten into" his "1-Search" on the Green Beret. He 
has skimmed old Time magazines, studied army recruitment 
materials, read Robin Moore's novel. Green Berets and con- 
ducted two interviews. But 1 wonder if he's going to throw up 
his hands and say "forget the whole thing" now that he has to 
synthesize his information in writing. That's the way I feel 
whenever 1 get to that point in a research project. 

Mickey just looked up from his work . . . smiling! and beck- 
oned to me. He was using the brief outline I gave him yester- 
day. He wanted to know what I mean by "give an honest 
assessment of the academic and personal qualifications you 
bring to Green Beret." 1 explained. He nodded. "Oh, O.K." 
and then WENT BACK TO WORK. HE HAS ALREADY 
BEEN WRITING FOR TWENTY MINUTES. 

2. What are the writing practices at home and in school? Dan Hall- 
ford (1980), a teacher-researcher in the Bay Area Writing Project 
credential program, approached the first part of this question by 
surveying students on what writing and how much occurred at 
home. Terry Lillya (1979), Alyce Miller (1980), and Lawrence 
Sheppard ( 1982), also teacher-researchers in the Bay Area Writing 
Project's credential program, approached the second question by 
asking students to complete journals and surveys on the writing as- 
signed and written in classes other than English. 



ERIC 



125 



Conclusion 



I regard this book as part of the professionaJization project now under- 
way in this country for K— 12 teachers. The goal of that project is a par- 
ticular vision of what K— 12 classroom teaching could be. In that vision, 
K— 12 classroom teachers are regarded as the experts on K-12 classroom 
teaching, are assumed to be serious thinkers about teaching, and are as- 
signed paid time outside the classroom to think about their teaching and 
the students in their classrooms. 

In schools, the first opportunity for funded action research by K-12 
teachers is typically the school assessment of writing under minimum 
competency statutes. A second opportunity is now available through the 
Research Foundation of the National Council of Teachers of English, 
which is accepting applications from classroom teachers for funds to do 
classroom research studies. Applicants should remember that these 
funds are not intended for research undertaken for a graduate degree 
progran* or fc^r travel or purchase of permanent equipment. Recent pro- 
posals From teacher-researchers have focused on: 

Effective strategies for peer evaluation (a comparison of different 
sets of responses from peers) 

Strategies for learning to use word processors (a descriptive study 
of four elementary students' learning to use the word processor) 

Themes in children's writing (a descriptive study of themes in the 
writing of six children, three boys and three girls, from kinder- 
garten through third grade) 

Teachers of grades K-12 are not going to get time off to think about 
their teaching unless they establish in some way the importance of such 
reflection, and teacher research is a way of beginning to establish such a 
tradition of inquiry among K-12 classroom teachers. It can provide ex- 
amples illustrating the importance of teacher research. Examples of 
some of the kinds of positive impact teacher research can have on teach- 
ing are listed in appendix A, in a selection from an article by Marion 
Mohr, one of the country's major contributors to the K— 12 teacher re- 
search movement. (I emphasize K-12 because college and university 
teachers have already established a tradition of inquiry.) 
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Conclusion 



Finally, teacher research is one way of beginning to construct a vision 
of K-12 teaching in which school district assessments include case stud- 
ies, and some faculty meetings and English department meetings in- 
clude time for teachers to give progress reports on their research and to 
demonstrate lessons that work. Tailing teachers they should do teacher 
research is, for me, an inadequate way to begin. A much more promising 
approach, in my experience, is to build teacher research projects into the 
school assessments which districts are willing to fund. The selling point 
for school districts is that after the papers have been holistically scored, 
the district needs to know some of the details about how students write 
in order to discuss intelligently the present writing program and its pos- 
sible effects on students. 

It is important that teacher research be shielded from some of the 
criticisms that researchers in the natural sciences level against one an- 
other Teacher research needs a different set of norms, appropriate to 
the interests and working conditions of K— 12 classroom teachers, and 
therefore I have insisted on a different name (teacher research) and a 
difference science (science of design). This insistence may strike some 
readers as odd, but I believe that the assumptions behind such distinc- 
tions will enable us to Judge what a first-rate teacher-preparation pro- 
gram should be (and not be), and which research projects belong in the 
natural sciences and which properly belong in the area of inquiry among 
K— 12 teachers. 

Teachers who do teacher research will soon discover how difficult the 
whole business can be. One common reaction, after the first happiness 
over a trend (increasing T-units from low to high categories), is dissat- 
isfaction with T-units, levels of generality, or stages — with language the- 
ory in general. George Miller's comments (1977, 181-82) on this point 
are helpful and at the same time an encouraging way to end this book: 

[ do find depressing the short supply of theories adequate to sup- 
port more insightful experimentation, but this depression is not 
mine alone. I have heard it expressed by several colleagues whose 
opinions I value. It is simply a fact: human languages are so com- 
plicated that good theories are hard to formulate. Without good 
theories, of course, only luck can guide us to make significant ob- 
servations in the field or the laboratory . . . Nobody ever promi.sed 
us that science would be easy ... I hope my emphasis on the diHi- 
culties will not obscure the real joy and pride we all felt in what was 
accomplished. 




Appendix A 

What Happened in Their 
Teaching? 



Marian Mohr 



1. Writing honestly about classroom problems, failures as well as suc- 
cesses, in a supportive atmosphere led to more self assurance and 
encouragement to change. The research logs, written under stress 
as they often were, in minutes between classes or during the times 
when the students themselves were writing, were honest writings, 
harsh sometimes, despairing sometimes. These writings and their 
authors were accepted by the other teachers and many found they 
shared the same problems. Teachers who avoided difficult ques- 
tions about their teaching, who tried to avoid sharing their writ- 
ings, were pulled up short by the other teachers in their response 
group. They would say to each other, "Maybe something else is 
going on. Have you thought about ...?'* Being honest with them- 
selves and with each other seemed to enable them to change. It was 
a difficult triple whammy — observing, writing, and analyzing 
what happened in their classes — a strain, as it was repeatedly de- 
scribed. It was also liberating. 

2. Their research plans became their lesson plans. At first most felt 
they were working double, both teaching and conducting re- 
search. As the weeks passed, partly out of necessity to save time, 
but also out of response to their student responses, some changed 
their plans to make them more in line with what they were discov- 
ering. They began to see teaching more as a learning process 
rather than a daily routine or performance. One of the research- 
ers[,] who was looking at writing to learn math, began to develop 
and change her math curriculum as she discovered more and 
more things that her students could do. A questionnaire would 
lead to another followed by an open class discussion that was taped 
and analyzed. Because they were more in touch with what their 
students were thinking, they did not plan in the same way that they 
had done previously. Tight[,] rigid lesson plans began to give. One 
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teacher invented a final exam that reflected her changed teaching 
ideas» met the requirements of her principal, and became part of 
her data. Another wove his data and findings back into his curric- 
ulum in a series of studies of American literature, at the same time 
recording the changes he himself was going through. For many 
their teaching and research became unified. One teacher wrote 
that she now ''takes the lead from her students." 

3. They switched from evaluating to documenting. Initially some ex- 
pressed disappointment with their data, as if it were a lesson plan 
gone awry rather than simply what they were going to analyze. 
The switch to documenting was freeing and reassured teachers 
who were accustomed to being disappointed in the work of their 
students. Irritating classroom behavior, seen as data, became in- 
teresting. Error became a sign of growth. 

4. They become more tolerant of creative chaos in their thinking 
(not in classroom behavior) and therefore more understanding of 
its appearance in their students' thinking and writing. One 
teacher called herself "a wishy washy Pisces researcher" as she con- 
tinually refined and developed her research question. They knew 
from experience what it means to discover your idea gradually as 
you write and do research. Revision became a commonplace, a 
fact of life. One teacher reported a sense of ''messiness" as part of 
her teaching, another that she felt she was "fluttering around 
hither and thither" as she did her research. Although the teachers 
were not completely comfortable with these feelings, they were ac- 
knowledged as part of the process and therefore as legitimate 
parts of the process of learning of their students. 

5. They changed the focus from teaching students to finding out 
what their students knew and then trying to help them learn. One 
teacher wrote 'Tm to the point where I ask them before I ask 
them." They discovered that their students knew more and could 
learn more than they had imagined. They reported asking more 
questions, listening more, and respecting the worries and con- 
cerns of the students as legitimate, waiting, rather than rushing in 
with a suggestion. They received the cooperation and interest of 
their students in their research. In some cases the students be- 
came partners in the project. The students became more aware of 
their own learning and writing processes. One student chose her 
own research name. Many of them read the drafts of the reports 
and made comments to the teacher-researcher. The teachers and 
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their students became learners together and the students began to 
see their teachers as learners. The teacher-researcher modeled 
the learning process for his or her students. 

6. The teachers were able to try new ways of teaching because they 
were very sensitive to the classroom variables. While researching, 
they were examining the context simultaneously with the teach- 
ing. Perhaps what happens with some attempts at teacher change 
is that even though teachers accept new ideas presented in an in- 
teresting, authentic and enthusiastic manner, if the ideas are not 
compatible with their classroom context, they will not work as they 
did at the inservice program. During research, however, the con- 
text is an examined integral part of the practice and the teacher is 
receiving constant response from students concerning the con- 
text, so that the idea gets a full trial. 

7. As a teacher of teacher-researchers, I found the same changes tak- 
ing place in myself I noticed happening to them. We became col- 
leagues learning together. I made honest and direct comments 
and responses to them about their work. I took more notes on 
what they said and talked less. On January 20 I noted in my 
Iog,'Tm developing a new teaching technique— sending out com- 
ments when they're too late to do any good and having them re- 
affirm what the researchers have already figured out for 
themselves." This happened accidentally at first because of the 
many times I returned comments to the teachers later than I had 
planned. I know that I was helpful to them on some occasions, and 
they helped me with the material I'm putting together for this ar- 
ticle. I'm not sure how permanent the changes are, but I know that 
I felt uncomfortable with some of the teaching I was doing in an- 
other course for teachers and I began to modify what I was doing 
there as well. 

One teacher who helped me by giving comments on this article in 
process asked, '^Are you going to say how hard it was?" It was hard 
because of the circumstances under which we were working and be- 
cause we were new at it. One January night after I got home from 
class I received a phone call from one of the teachers who said, **It's 
the first night I haven't been tired since the vacation." We worked 
hard, but it was a different kind of tired. 

(From Marian M. Mohr, Window Sill: Teacher-Researchers and the Study 
of Writing Process) 
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Appendix B 

Evaluation Designs for Practitioners 



Maurice J. Eash 
Harriet Talmage 
Herbert J. Walberg 

Planning and implementing any facet of the educational program call 
for decision making whether the project concerns the program of an en- 
tire school system or the day-to-day practice of a teacher in a single class- 
room. The interactive nature of the educational process produces a 
dynamic environment; hence, decisions made at one point in time re- 
quire reassessment at the next point in time before another round of de- 
cisions can begin. Evaluation provides a framework for building a 
systematic data base to aid in making decisions in school and classroom 
practice. With an appropriate data base, problems can be reformulated, 
both potential and actual consequences can be analyzed, and, as a result, 
the processes can be redirected. 

Practitioners are not afforded the luxury of ideal laboratory condi- 
tions. The natural settings of the classroom, the school, or the school 
system place constraints upon the type of data obtainable; hence, edu- 
cators must work with less than an ideal experimental design.' 

Four evaluation designs used in natural settings are described in the 
following sections.^ Each involves an evaluation study that takes into ac- 
count a variety of constraints, but nevertheless provides a basis for :>ub" 
sequent program and/or organizational decisions. The studies range 
from a true experimental design, one that necessitates the random as- 
signment of students to experimental and control groups, to a design 
that lacks both randomization and comparative groups. 

In each section, the basic paradigm of the evaluation design is sym- 
bolically presented. Four symbols identify the elements of the para- 
digms: R— randomization; X— treatment; O— observation; and in some 
cases, DA— design analysis. Subscripts denote specific treatments and 
observations. Observations (O) to the left of the treatment (X) denote 
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pretest data, and to the right, posttest data. The experimental group 
symbols appear above the control group symbols. A broken line between 
the groups indicates nonequivalent groups. 



A true experimental design is characterized by its randomization of sub- 
jects to treatment — "randomly dividing the litter among treatments" — 
and is the conventional laboratory-science way of exercising this control. 
The strength of the design, randomization for control of error, is also a 
major source of difficulty in field evaluations because studies are con- 
ducted where scheduling, teacher preferences in assignment, luncheon 
arrangements, and a myriad of other considerations enter in. Thus one 
finds the experimental design infrequently used in reported evalua- 
tions. However, because of its power to bring forth more valid findings, 
we suggest that evaluators search for ways to employ it in field situations. 
An example drawn from an evaluation of a curriculum model set up un- 
der a Title III grant illustrates the power of a true experimental design 
to bare true differences and the weaknesses of nonrandom comparison 
groups. Clocktown, a fast growing suburb in a major metropolitan area, 
received a three-year grant to design a middle school curriculum which 
would break sharply with the conventional curriculum in the seven other 
junior high schools. The new curriculum included: 1) greater parent in- 
volvement, 2) a more humanistic orientation, 3) promoting greater 
achievement, 4) promoting more affective growth, 5) integrating pupil 
personnel services within the curriculum, and 6) offering these changes 
at a per-pupil cost competitive with the costs in the other junior high 
schools. After one year of planning, the two-year experimental school 
opened. 

Through a combination of events and advanced planning, a true ex- 
perimental design became possible. A pool of 600 potential students for 
the Model School was developed through volunteers and recruitment. 
The Model School was established to enroll 300 students, and all appli- 
cants were informed that a random selection would govern admission to 
the school. The outside evaluators randomly selected the 300 students, 
thereby creating an experimental group (those in the Model School) and 
control groups (those who were in the original pool of applicants but 
were not admitted to the school). 

A number of measurements were taken to evaluate the goals of the 
Model School. Whenever possible, the results were analyzed within the 
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experimental designs of Experimental Group vs. Control (Jroup. One 
example of the strength of the experimental design over a quasi-exper- 
imental comparison group design is shown in Figure 1, where achieve- 
ment test scores for the Model School, the Control Schools students, and 
the district average for all junior high school eighth graders are 
graphed. This graph shows dramatic differences in curriculum treat- 
ment between the experimental and the control groups in selected areas 
of mathematics and reading achievement. If the district averages had 
been substituted for the control group results, much of the effect of the 
curriculum change would have been obscured, for clear!;' the achieve- 
ment of the pool of students is not representative of the disti *ct\s average 
achievement. 
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Figure I. Reading and Mathematics SRA .Achievement (irade Equivalencies lor (JradcH: 
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A second example of how true dif ferences are masked is seen when a 
volunteer group instead of a randomly selected control group is used in 
a comparison of classroom observations made in volunteer teachers' 
classrooms. In year two, the control group of classrooms to be observed 
was randomly selected to obtain a more representative sample of class- 
room practice to compare with the Model School. The differences are 
much sharper since the first year volunteer control group classrooms 
were much closer to the experimental group in practice than were the 
typical district junior high school classrooms. (See Figure 2.) The ex- 
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Figure 2. Mean Ratings for Randomly Selected Experimental Classrooms, Control Class- 
rooms, and Volunteer Classrooms 
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perimental design is invaluable to control error and to trace the attri- 
bution of results to treatment more clearly. Every effort should be made 
to use it when the question of curriculum effects is at issue or a sum- 
mative evaluation is at stake. 



Nonequivalent Control-Group Design 



O X O 

"6x6 



It is usually difficult to assign students randomly to classrooms receiving 
special treatment or to assign teachers randomly within schools to spe- 
cial programs. In the first itistance, parents tend to resist changes that 
vary from the established curriculum without their approval. In the sec- 
ond instance, teachers assigned to new programs involuntarily may af- 
fect the outcomes negatively. Through a nonequivalent control-group 
design, the handicap due to the lack of randomization is compensated 
for in several ways. 

The Textville School District study concerned the problems of eval- 
uating four new reading series to select one for system-wide adoption. 
Instructional materials play a significant role in the educational process 
for 75 percent of the instructional time in the classroom, and 90 percent 
of the homework time is devoted to these materials. Thus, adoption can- 
not be taken lightly. Selecting a reading series frequently entails ideolog- 
ical confrontation to the neglect of facts. Publishers display their 
materials with attractive illustrations and slick copy, and groups of 
teachers espouse one approach to reading instruction or another as the 
final solution to all reading problems. Therefore, an evaluation design 
was developed to serve two purposes: 1) to overcome the difficulties of 
nonrandomization and 2) to establish a data base for making selection 
decisions on the basis of facts rather than ideological quibbling. 

In designing the evaluation study, the drawbacks of nonrandom as- 
signment of students and teachers to experimental and control groups 
were taken into consideration by obtaining pretest and posttest data, em- 
ploying multiple treatments for comparisons with the traditional treat- 
ment and comparisons among the treatments, and using the class rather 
than the individual student as the unit of study. An adaptation of the 
nonequivalent control-group design is illustrated in Figure 3. Pretest 
(Oprex) and posttest (Oposix) reading achievement data were obtained. 
Data on teacher characteristics (Oi) were initially collected. Subsequent 
to the introduction of the treatment (X), data were obtained on learning 
environment variables (Og: competitiveness, cohesiveness, difficulty, 
friction, and satisfaction) and on instructional characteristics (O3: locus 
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Figure 3- Nonequivalent Control-Group Design Paradigm 



of instructional decisions, variety and utilization of materials, and stu- 
dent behaviors). 

The Textville schools and teachers were encouraged to participate in 
the study. Sixty classes from 12 schools were chosen and represented the 
range of ability, of socioeconomic, racial, and ethnic backgrounds, and 
of geographic locations found in the district. Assignment to a reading 
series by grade level is shown in Figure 4. For each reading series, the 
materials were field-tested in three different schools in grades 1, 2, 3, 
and 6. In all, the data included 12 different classes per series. 

Two constraints were imposed on the design: 1) All four classes in a 
school field-testing the reading materials must use the same series; and 
2) the best educational interest of the students must supersede the de- 
sign of the study. And, indeed, this came to pass: One class found too 
many difficulties with the series at the peril of impeding their reading 
progress, and the class was removed from the study. 

The data were analyzed to provide information on four questions: 

• Do the classes using one series obtain higher reading scores on the 
reading achievement posttest than classes using another series? 

• Do the classes using one reading series perceive their learning en- 
vironment differently than do classes using another reading series? 
Do the learning environment and reading series taken together af- 
fect achievement? 
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Figure 4. Assignment to Ireatment Matrix 
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• Do selected teacher characteristics in conjuiiLiion with a given se- 
ries affect reading achievement? 

• Does instruction differ in chisses using different reading series? 

Statistical analyses indicated that the pretest score is the single most 
significant predictor of reading achievement despite teacher character- 
istics and regardless of the reading series. After the effects of the pretest 
scores are removed, competitiveness is the only other variable that pre- 
dicts reading achievement. The higher the competitiveness in the learn- 
ing environment, the lower the reading achievement. There are no 
significant correlations between competitiveness and reading series, 
teacher characteristics, or instructional characteristics. 

The final selection decision for the Textville School District shifted 
away from an emphasis on ideological issues such as phonics-oriented vs, 
nonphonics-oriented reading approaches or linguistic vs, nonlinguistic 
reading approaches. In place of these, attention was focused on the in- 
structional aspects of a reading program that tend to reduce competi- 
tiveness, and on such concerns as the district's philosophy of reading, 
cost factors, implementation problems, and the degree of teacher de- 
pendence on outside support. 



Time-Series Design 
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Practitioners are frequently faced with the necessity of making major 
program changes which reorganize curriculum and structural arrange- 
ments. Not infrequently, such changes are precipitated by external 
forces that are impatient with the setting up of an evaluation design that 
would require the establishing of control groups before the change is 
made. In these cases, data are frequently desperately needed by admin- 
istrative decision makers if they are not to be at the mercy of rumor and 
pressure groups. Such was the case of the Parkland School District, 
which was suddenly under a legal mandate to integrate its schools. De 
facto segregation resulting from segregated housing placed practically 
all the black population in one elementary school and the white popu- 
lation in six schools, and produced segregation up through grade 6. 
The junior high schools were int-egrated in name, but not always in real- 
ity, for the students segregated themselves by race in the lunchroom and 
on the playground. Faced with a legal mandate to bus students to 
achieve equal racial proportions in all seven elementary schools. Park- 
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land administrators requested an outside evaluator to help them set up 
an evaluation design that would provide basic data on these (|ucsti()n,s: 
1) What effects does the structural reorganization required by busing 
have on student achievement and on the learning environment? 2) What 
data would be useful for program planning and for alerting the admin- 
istration to potential difficulties? 

The evaluation was hampered by the inability to set up control 
groups through randoniizatiorr Moreover, since die entire school system 
was involved, no separate control groups were available. Within these 
limitations, it was decided to use a time-series design for a two-year pe- 
riod that would allow within-the-group comparisons, use a multiple col- 
lection of data, and give a reading on several indices of progress. 
Experience indicates that over the two years many productive hv- 
potheses were generated and an invaluable data base ibr charting prog- 
ress in achievement, race relations, and classroom instruction was 
established. 

A pretest and posttcst on general achievement was given every child 
in the fall and spring. Since there were previous local norms available, 
these data quieted fears that integration was destroying achievement, A 
learning environment measure, administered in the spring, revealed 
that further curriculum planning was needed to improve the learning 
environment for both white and black studenij, in different schools. An 
analysis of the learning environment and achievement measures re- 
vealed tliat some schools appeared to be much more successful than 
others in providing a stimulating learning environment and promoting 
achievement. While the lack of adequate controls limited generalizations 
or conclusions, these data did pinpoint areas for closer investigation by 
administrators and teachers. One of the more immediately useful ap- 
plications of evaluation data came when rumors of the deterioration of 
discipline in one school swept the community. The recently adminis- 
tered learning environment inventory profile calmed both the school 
board and the public by its demonstration that the students in this 
school perceived their environment very much as did their counterparts 
in other schools, and that there was no greater conflict or disruption in 
their school than in the others. 

A third area of data was an analysis of the records of disciplinary 
cases in the junior high schools. These again provided some .short-term 
data as the basis of decisions, since the offenses that took up most of ad- 
ministrators' and guidance counselors' time were being committed by a 
very small group of students. (See Figure 5.) Interracial problems were 
not as prevalent as intraracial problems. A second year of charting these 
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Figure 5. Summary Graph of Frequencies of Behavioral Incidents 

behavioral incidents showed that the concentration of social services on 
the few major offenders had removed them from the behavioral records 
in the second year In addition, it was found that interracial conflict had 
decreased. Thus, one is led to conclude that the time-series design pro- 
vides a useful data base for decision making in a situation where tensions 
induced by structural changes cry for the voice of rationality. One must 
admit that these data have limited generalizability, but they have been 
invaluable in the context in which they are collected and in demonstrat- 
ing that evaluation can serve several purposes in applied settings. 
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No Comparison 
Group Design 



Design Analysis X — O Design Analysis 



X — O 



Not infrequently, an evaluator is confronted with a program that is to be 
used but is being undertaken with restraints that forestall the use of 
control groups. Is usefulness of evaluation forestalled under these cir- 
cumstances, and must one retreat to the rhetoric of castigating short- 
sightedness in the developer? The fourth example deals with such a 
problem. 

An outside private agency provided funds to increase and improve 
the teaching of the arts in schools. Launched from very broad objec- 
tives, "to enable parents and community leaders to use the arts as com- 
munication tools,'* the agency requested evaluation assistance to improve 
the series of workshops that it had designed for teachers. 

From the workshops' guides that were presented and from the fund- 
ing proposal, an analysis of workshop activities to achieve the goals was 
prepared. The activities proved to be a better source of goals than the 
diffuse general objectives. The evaluation design was concerned with: 
1) Were the activities being taught in the workshops? 2) Were they per- 
ceived as useful by teachers since they incorporated creative and non- 
conventional teaching approaches? 3) Were they being implemented in 
classrooms and did they maintain the integrity of the activities? 

The evaluators were not permitted to gather data from control classes 
in the schools, nor were they to observe the instructors assigned to the 
workshops. The design of the evaluation structured the gathering of 
data by analyzing the program and developing an activity analysis, 
which was then converted into an instrument to be used by teachers to 
evaluate workshop activities on four dimensions: 1) the workshop par- 
ticipants' reaction, 2) whether teachers used any one activity in the class- 
room, 3) the students* reactions, and 4) ease of implementation. A 
second source of data was gathered from a pretest and a posttest of 
learning environments in the workshop participants' classrooms. A 
third source of data was observation in classrooms where teachers 
taught the workshop activities to their students. A fourth source of data 
was a standardized teacher evaluation questionnaire to evaluate the 
workshops. 

From these data an analysis was made of the workshops, and recom- 
mendations were rendered on which workshops and what activities were 
most useful in the classroom. As this evaluation progressed, feedback 
sessions were held with workshop directors to assist them in conducting 
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the next semester's 'vorkshops. Evaluation in this case focused on pro- 
vicHng clarity to a group of program developers who were working in an 
ambiguous area. Although many of the traditional parameters of an 
evaluation design are lacking, these are data that can he generated and 
comparisons that can be made to shape the educational product. In the 
sense of serving to improve practice through the establishment of a data 
base and promoting meaningful comparisons for practitioners, the eval- 
uation design remains true to its calling in bringing rationality to play 
on educational activities. 

Cooperative Planning in Evaluation 

rValuation is often v iewed by {practitioners as being outside their reach: 
The designs are incomprehensible, the data are too costly to gather, the 
participants are threatened by the potential of the findings, and the ef- 
fects, efforts, and efficiency cannot be evaluated with any degree of ob- 
jectivity anyway. Our experience, gatheied over a wide variety of 
pr()jects, would indicate that practitioners are handicapped by too nar- 
row a view of evaluation and by their failure to systematically build an 
evaluation design into projects. Moreover, troublesome problems are not 
approached through an e\'aluati()n design which in its use converts rhet- 
oric to a factual base, as was illustrated in the example on the reading 
series. In short, decision making and choice taking are blind through 
the lack of evaluation designs which open up ojptions and permit an ear- 
lier use of correctives in program planning. 

To provide for an evaluation design in the early stages makes for a 
more open conmiitnient to the major goals of a project, and establishes 
a degree of latitude for shifting direction based on evidence which often 
is denied when the program participants' personal commitments to a 
pr()ject deepen witfi effort. Evaluation can serve to keep the focus on the 
(jLiest for a better way to provide education as opposed to espousing a 
dogma of "the way to provide quality education." If evaluation is seen as 
a necessary part of pr()jects and problem solving, the use of evaluators 
and evaluation findings becomes as significant as the appropriate use of 
evaluation designs. Findings must be implemented to be effective in de- 
cision making. 

At the Office of Evaluation Research, we have found that cementing 
an early working relationship between the evaluators and the practition- 
ers is the best guarantee of the use of evaluation findings. As outside 
evaluators, this entails buikling an evaluation design early in the project 
with inputs from practitioners on their needs for data. In another con- 
text, we have referred to this process as a coaci 'wnal relationships where the 
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two parties are engaged in a mutual task with a commitment to the dis- 
covery of options and the search for truth. Extra effort is required from 
the evaluators to explain designs and their strengths and constraints; 
but these early sessions also build the foundation of commitment to fol- 
low the findings wherever they may lead. The process is coactional in 
that the evaluators perceive the context in which the evaluation design is 
being used and it is early on plans for implementation of findings at ap- 
propriate junctures. Our contention is that many evaluation reports are 
superfluous because they are ill-timed to the schedule of information 
needs of practitioners, or return findings that are arcane and remote 
from the decisions that are pressing the decision maker. We see, as im- 
perative to success, the need to be sensitive to the roles of the evaluators 
and practitioners and their relationships in building evaluation designs. 
The four evaluation designs described illustrate applications of a meth- 
odology in a field context. Brevity did not permit the description of roles 
and relationships, though they are implicit in the applications. Appro- 
priate use of evaluation designs, we contend, can bring rationality into 
play in field-based problems and can improve educational practice. 

TM Report 35, published in December, 1974, by the ERIC Clearinghouse on Tests. 
Measurement, and Evaluation, Princeton. New Jersey 08540. 



Notes 

1. The studies used to illustrate the designs were conducted by the Office of 
Evaluation Research, College of Education, University of Illinois at Chi- 
cago Circle. 

2. For additional designs, the reader may wish to consult Donald T. Camp- 
bell and Julian (]. Stanley, Experiment I and Qiiasi-Experimental Designs for 
Research. Chicago: Rand McNally Co.npany, 1963. 

3. Maurice J. Eash, "Transactional Evaluation of Classroom Practice," in 
Studies in Transactional Evaluation, ed. Robert M. Rippey. Berkeley: Mc- 
Cuchan Pub. Corp., 1973. 
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A Note on Sampling 

and Statistical Tests 



Random sampling can help the action researcher keep a project within 
the resources available in schools. If the assumption is that the features 
counted in a sample represent what one would expect to find in the given 
population, then the sample must be drawn randomly from the given 
population. In simple random sampling, each paper in the population 
has a unique two-digit number, and individual sample papers are se- 
lected by choosing two-digit numbers from the table of random num- 
bers below. Where one begins on the table is arbitrary. If one begins in 
the upper right corner and goes down, the first four numbeis are 51, 26, 
68, and 12. If a number does not appear in the population, ignore it. 
The size of the sample should be based on some estimate of the diversity 
within the population. For a class of 30 with a great range of skills, select 
28 papers. For a school district population of 8,000 with a great range 
of skills, select 367 papers if possible. These estimates come from a best- 
case formula in Krejcie and Morgan (1970). But best-case is not always 
possible. In any circumstance, try to get at least 5 samples for each skill 
you want to discuss. The point of sample size is that if all the students in 
a population are exactly alike, a sample of one is just fine. That one will 
produce results representative of the population in question. Because 
students are not exactly alike, however, the general rule of sample size is 
that more is usually better. But more requires more time. 
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8834 


6429 


8691 


0143 
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Random Numbers 
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4522 5749 

7195 6234 

0054 0810 

5166 5433 

1247 3793 



8084 3932 

e426 7148 

2937 2040 

0381 9686 

7415 7819 



^7678 3549 

9945 0358 

2299 4198 

5670 5129 

1783 0506 



0051 6761 

3242 0519 

0846 3937 

2103 1125 

4878 7673 



6952 7041 

6550 1327 

3986 1019 

3404 8785 

9840 6629 



8529 7842 

8973 3440 

9307 2959 

2923 4276 

6372 2808 

6922 1807 

9862 8336 

3371 1530 

6712 9402 

3071 8782 

4022 9734 

9682 8892 

6705 2175 

1872 8292 

2559 7534 



7203 1844 

4366 9242 

5904 9012 

9467 9868 

1238 8098 

4900 5306 

6453 0545 

5104 3076 

9588 7019 

7157 5941 

7852 9096 

3577 0326 

9904 3743 

2366 8603 

2281 7351 
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0050 
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4215 9969 

0922 5887 

4529 7197 

3382 7244 

4099 6705 

8634 2331 

5967 8447 

4143 5845 

4223 6555 

2252 8109 

7056 9331 

8517 4376 

3032 8432 

4357 1072 

9613 2000 



6948 5643 

4883 1177 

7179 3239 

1781 8037 

2386 2830 

7247 3230 

3017 5709 

2095 6127 

7947 2474 

5880 9912 

1317 7833 

0788 5443 

0612 7972 

6822 5611 

0327 6145 
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3751 
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5399 


5175 


8894 


0296 
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0400 


2272 


6074 


8827 


2195 


2532 


7680 


4288 


6807 


3101 


6850 


6410 
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4722 


6721 


0838 


3632 


5355 


9369 
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7681 
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6184 
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9838 


6123 


9397 


4019 


8389 


9508 


8610 


1880 


7423 


3384 


4625 


6653 


2900 


6290 


9286 


2396 


4778 


8818 


2992 


6300 


4239 


9595 


4384 


0611 


7687 


2088 


3987 


1619 


4164 


2542 


4042 


7799 


9084 


0278 


8422 


4330 


2977 


0248 


2793 


3351 


4922 


8878 


5703 


7421 


2054 


4391 


1312 


2919 


8220 


7285 


5902 


7882 


1403 


5354 


9913 


7109 


3890 


7193 


7799 


9190 


3275 


7840 


1872 


6232 


5295 


3148 


0793 


3468 


8762 


2492 


5854 


8430 


8472 


2264 


9279 


2128 


2139 


4552 
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2524 


8601 


3372 


1848 


1472 


9667 


8277 


9153 


2880 


9053 


6880 


4284 


5044 


8931 


0861 


1517 


2236 


4778 


6639 


0862 


9509 


2141 
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1450 
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8837 


7686 
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2894 
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8399 


8175 


3525 


1646 


4019 


8390 


4344 
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2557 


6395 


9496 
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4402 


5498 


0422 


3335 



(D. B. Owen, Handbook of Statistical Tables, © 1962, Addison- Wesley, Read- 
ing, Massachusetts. Pg, 519, Table of Random Numbers. Reprinted with 
permission.) 
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It is also recommended, if possible, to use appropriate statistical tests 
to determine when pre/post or other comparison numbers are asserted 
to be significantly different. In this case, significant difference means 
that the difference between the two numbers is not a matter of chance 
and, therefore, may be attributable to other causes. If the comparison 
numbers are based on a continuous scale (1, 23, 55, 37, 9, 103), the t-tcst 
can be used to determine statistical significance. 

A t-cest has three parts: (1) two means or average scores from two 
groups or two tests of the same group (average number of words in 
groups A and B), posttest scores from groups A and B or repeated mea- 
sures of the same group with pretest being A and the posttest being B); 
(2) the variance in groups or tests A and B, showing the range or dis- 
persion of a group's scores around the mean or average; and (3) sample 
size. Many hand calculators will provide the mean and variance for each 
group if all of the individual scores in the sample are entered. The for- 
mula for the t-test is as follows: 

Difference between two means 
/ = 

/ Variance of sample A ^ Variance of .sample B 
yj Size of sample A Size of sample B 

Difference between two means 
Standard error of the difference 

The difference between the two means is then divided by the standard 
error of the difference, a measur^^ ot the dispersion and t ange of scores 
in the two samples, and the result is the t-statistic. When the t-statistic 
has been calculated, the researcher must consult a t-table Jo find the 
value of the t-statistic. P'irst, find the degrees of freedom (total students 
in the sample minus the number of groups) and find the column for a 5 
percent chance of error It is a convention among statisticians to accept 
as tolerable a 5 percent chance of error Notice that a 1 percent chance 
of error is a harder standard to meet, requiring a higher t-value. 

If the degrees of freedom are twenty-eight, then the t-value in the 5 
percent error column is 2.048. This means that the t-statistic calculated 
using the formula above must be greater than 2.048 in order to be sta- 
tistically significant. 

The assumption of the t-test is that the two groups being compared 
are comparable and come from essentially the same population. If it 
turns out that from the very beginning one group was obviously more 
skillful than another, then an analysis of covariance can be used to adjust 
scores so that groups are comparable. Ask for help with this. 
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Values of t at the 5% and 1% Levels of Significance 



Degrees 

of 
Freedom 


57c 


17c 


Degrees 
nf 

Freedom 


5% 


17c 


1 


12,706 


63,657 


32 


2,037 


2.739 


2 


4.303 


9,925 


34 


2,032 


2.728 


3 


3.182 


5,841 


36 


2,027 


2.718 


4 


2.776 


4,604 


38 


2,025 


2^711 


5 


2.571 


4,032 


40 


2,021 


2.704 


6 


2.447 


3,707 


42 


2,017 


2.696 


7 


2.365 


3,499 


44 


2,015 


2.691 


8 


2.306 


3,355 


46 


2,012 


2.685 


9 


2.262 


3,250 


48 


2,010 


2.681 


10 


2.228 


3,169 


50 


2,008 


2.678 


11 


2.201 


3,106 


55 


2,005 


2.668 


12 


2,179 


3,055 


60 


2,000 


2.660 


13 ' 


' 2.160 


3,012 


65 


1,998 


2.653 


14 


2.145 


2,977 


70 


1,994 


2^648 


15 


2.131 


2,947 


80 


1,990 


2.638 


16 


2.120 


2,921 


90 


1,987 




17 


2,110 


2,898 


100 


1,984 




18 


2,101 


2,878 


125 


1,979 


2.616 


19 


2,093 


2,861 


150 


1,976 


2.609 


20 


2,086 


2,845 


200 


1,972 


2.601 


21 


2,080 


2,831 


300 


1,968 




22 


2,074 


2,819 


400 


1,966 


2.588 


23 


2,069 


2,807 


500 


1,965 




24 


2,064 


2,797 


1000 


1.962 


2.581 


25 


2,060 


2,787 


X 


1.960 


2.576 


26 


2,056 


2,779 








27 


2,052 


2,771 








28 


2,048 


2,763 








29 


2,045 


2,756 








30 


2,042 


2,750 









(Reprinted with permission of the Free Press, a division of Macmillan, Inc. 
from Statistical Methods for Research Workers, I4th ed., by Ronald A. Fisher. 
© 1970 University of Adelaide.) 



T~tests are used for measurements along some continuous scale. 
However, some measurements are binomial, a two-sided yes/no, disa- 
gree/agree, or pass/fail measurement. In these cases, the numbers are 
the frequencies for each side. The most commonly used statistic for data 
in the form of frequencies is the chi-square (X^*). The basic idea of chi- 
square is that when two answers are available, the chances are that the 
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frequencies will split 50/50. Thus, in a class of 30, 15 should answer "yes" 
and 15 should answer "no." If 20 answer "yes" and 10 answer "no," then 
chi-square will indicate whether or not the difference between the two 
answers is still within the realm of chance or outside the realm of chance 
and thus statistically significant. Many hand calculators provide the 
means to calculate chi-square values. 

Numbers are used for different purposes — some to number a scale 
(nominal, ordinal, interval, and ratio), others to describe a tendency 
(mean, median, and mode), still others to show distribution, ancrbt-hers 
to show relationships. These are defined below. Two of the critical mea- 
sures are the averages, showing a central tendency, and the measures of 
dispersion, showing the range among scores. The chart on pages 148- 
49 summarizes the use of these two types of measures. 



Overview of Statistical Methods 

A. Numbers and Their Use 

1. Nominal Scale — in place of a name (to identify). 

2. Ordinal Scale — to indicate order (to rank). 

3. Interval Scale — to indicate equal intervals (to add and 
subtract). 

4. Ratio Scale— to indicate ratio (to multiply and divide). 

B. Central Tendency ("Averages") 

1. Mean 

2. Median 

3. Mode 

C. Distribution (Spread) 
L Standard Deviation and Variance 

2. Semi-interquartile Range 

3. Range 

^ Range ^ ^^^^^ standard deviation when = 100) j 

D. Comparisons and Relationships between Numbers 

L Siynple Conelation — measures the degree of relationship 
between two variables. May be positive (direct) or nega- 
tive (indirect or inverse). 

2, Partial Conelation — involves the relationship between 
two variables in a situation where three or more vari- 
ables are present, holding one or more variables con- 
stant and allowing the others to vary. 

3. Multiple Correlation — involves the correlation between a 
dependent variable (or a criterion variable) and an opti- 
mally weighted combination of two or more independ- 
ent (predictor) variables. 
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4. Factcn- Analysis — a technique for analyzing patterns of in- 
tercorrelation among many variables, isolating the di- 
mensions to account for these patterns of correlation 
and, in a well-designed study, to allow inferences con- 
cerning the psychological nature of the construct repre- 
sented by the dimension. 

5. z-Ratio or i-Raiio — test the (null) hypothesis that two 
samples come from two populations with the same 
mean and differ only because of sampling error, (z ap- 
plies to populations with or without equal variances; i 
assumes the population variances are equal.) 

6. Aiialysis of Variance — tests one or more (null) hypotheses 
that I he means of all groups sampled come from popu- 
lations with equal means and differ only because of 
samp)ing error. (F test: the technique used in Analysis 
of Variance which compares the Between-group vari- 
ance to the Within-group variance.) 

7. Chi-sqiiare — a measure of squared deviations between 
observevd and theoretical numbers in terms of frequen- 
cies in categories or cells of a table, determining 
whether such deviations are due to sampling error or 
some interdependence or correlation among the fre- 
quencies. It involves a comparison of frequencies of two 
or more corresponding groups. Very useful in tables in- 
volving frequencies of Yes-No answers. 

(From William B. Michael and Stephen Isaac, Handbook in Research 
and Evaluationy 2d ed., copyright 1981 by EdITS Publishers, San 
Diego, California 92107 Fieprinted by permission.) 

Measures of Central Tendency and Variability 

A. When to use the three averages: 

1. Compute the arithmetic mean when: 

a. The greatest reliability is wanted. It usually varies 
less from sample to sample drawn from the same 
population. 

b. Other computations, as finding measures of variabil- 
ity, are to follow. 

c. The distribution is symmetrical about the center, and 
especially when it is approximately normal. 

d. We wish to know the "center of gravity" of a sample. 

2. Compute the median when: 

a. There is not sufficient time to compute the mean. 

b. Distributions are markedly skewed. This includes the 
case in which one or more extreme measurements 
are at one side of the distribution. 

c. We are interested in whether cases fall within the up- 
per or lower halves of the distribution and not par- 
ticularly in how far from the central point. 

d. An incomplete distribution is given. 
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3. Compute the mode when: 

a. The quickest estimate of central value is wanted, 

b. A rough estimate of central value will do, 

c. We wish to know what is the most typical case. 
B. When to use the three measures of dispersion: 

L Use the range when: 

a. The quickest possible index of dispersion is wanted, 

^^^"^^ ^ one standard deviation when ^ 100 
6 

b. Information is wanted concerning extreme scores, 

2. Use the semi-interqxuirtile range, Q, (see preceding page) 
wiien: 

a. The median is the only statistic of central value 
reported, 

b. The distribution is truncated or incomplete at either 
end, 

c. There are a few very extreme scores or there is an ex- 
treme skewing, 

d. We want to know the actual score limits of the middle 
50 percent of the cases, 

3. Use the standard deviation when: 

a. Greatest dependability of the value is wanted, 

b. Further computations that depend upon it are likely 
to be needed, 

c. Interpretations related to the normal distribution 
curve are desired. 

(Note: The standard deviation has a number of useful re- 
lationships to the normal curve and to other statistical 
concepts.) 

(From J, R Guilford, Fundamental Statistics in Psychology and Educa- 
tiouy 4th ed. Copyright McGraw-Hill Book Company, New York, 
1965. Reprinted by permission of McGraw-Hill Book Company.) 



Appendix D 

Using Expressive Writing 
to Teach Biology 



Robert Tierney 
Introduction 

Though most high school biology teachers agree, to some extent, that all 
teachers should be teachers of writing, they are often reluctant to include 
student writing exercises, beyond normal transactional reporting,* in 
their programs. Biology teachers point, with some pride, to the numer- 
ous lab write-ups, student reports, and tests they have corrected for 
grammar, spelling, and neatness as their contribution to the improve- 
ment of writing. Expressive writing, the language used in friendly talk, 
or the writing which takes place during the initial phase of thinking 
through a problem, is best left to the English teacher down the hall. 
After all, they reason, English teachers are trained for that sort of thing. 

Probably the primary reason for not including expressive writing in 
the biology class is lack of time. Time devoted to the teaching of writing 
is time lost for biology; there isn't enough time to present all of the bio- 
logical subject matter that should be presented. Biology teachers, like 
most teachers, find themselves forced to make value judgments about 
which topics to delete, and they sometimes feel guilty about their deci- 
sions afterward. How can one justify a skimming over of the Echino- 
derms, or short-changing the Kreb's Cycle? 

Another reason for not emphasizing writing in the biology class is the 
paperwork load. As it is, most biology programs include labs every week, 
and labs mean lab reports or workbooks to be corrected. Add to the lab 
write-ups a few student reports, a notebook, and other assignments, and 
it means confronting a stack of uncorrected papers that would intimi- 
date even the most dedicated tutor 

Probably the saddest reason for not including expressive writing is 
many biology teachers fail to realize its potential as a learning tool be- 
cause they are not familiar with writing as a process. Few biology teach- 
ers are themselves writers. Yet modern biology instruction requires a 
hands-on, inquiry think-through-the-problem approach. Expressive 
writing is a means of thinking through a problem. The student is free 
to do his [or her] thinking on paper without fear of the teacher as an 
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examiner Expressive writing can provide the biology student with the 
essential experience of free inquiry — the essence of the scientific 
method. 

The biology student who is allowed time, and encouraged, to write ex- 
pressively about what he [or she] has been presented in biology will be a 
better student. He [or she] will have a more thorough understanding of 
the biological concepts and will experience both the pain and the thrill 
of problem solving. Certainly his [or her] reports will be more interest- 
ing for the teacher to read, and that, in itself, might make the effort 
worthwhile. 

This experi.i.ent is an attempt to suggest some techniques for includ- 
ing expressive writing in the biology class and to objectively evaluate 
their potential. Perhaps it will encourage other biology teachers to try 
some of the ideas, refine them, or develop new ones. 

Background 

The School 

Irvington High School, built in 1961, is situated in the suburban com- 
munity of Fremont on the southeastern shore of San Francisco Bay. It is 
one of four high schools in a rapidly growing community The student 
body is a heterogeneous mixture of Anglo-Saxon, Chicano, Asian, and 
Black students. The approximately 2000 students are taught by a faculty 
of 80 teachers, most with ten or more years of experience. 

The Teachers 

This experiment was made easier by the uniqueness of the situation at 
Irvington High School. All of the biology, four sections with a total of 
136 students, is taught by me and my long time friend, Harry Stookey. 
We have similar academic backgrounds and interests. We both possess 
California General Secondary Teaching Credentials. We have both 
taught for twenty-six years. We were both evaluated by the same admin- 
istrator this year, Mr. Richard Guidici, Vice Principal, and given the 
same rating — excellent. We are both the same age. The probability of 
finding a situation where the teachers involved are so closely matched 
seems unlikely. It provides a unique opportunity for a controlled edu- 
cational experiment. 

The essential difference between me and Harry Stookey is that I have 
published some freelance writing and attended a five week Invitational 
Workshop sponsored by the Bay Area Writing Project at the University 
of California, Berkeley. 
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The Students 

A profile of the biology classes was made to determine what differences 
existed between the composition of my classes and Harry Stookey's. We 
were able to obtain the student scores for the Fremont Unified School 
District Competency Tests and used the written language skill and the 
reading comprehension scores, along with other data, to construct the 
profile (see Figure 1). 

Apparently my students had slightly lower ability in both written lan- 
guage skills and reading comprehension. They also tended to miss class 
more often and were younger, as indicated by year in school, than Harry 
Stookey's classes. They did, however, turn in a higher percentage of their 
assignments. 

Design of the Study 

The Problem 



Do secondary biology students learn and retain fundamental principles 
of biology better in a biology program which stresses expressive writing 
than in a class that uses only traditional expository writing? 





Average 
Score — Written 
Language Skill 


Average 
Score — Reading 
(Comprehension 


Percentage of 
Assignments 
turned In 


Average 
Days Al)sent 
Per Pupil 


Number of 
Students 
Enrolled 


Tierney I 


85.5 


88.r) 


92 


7.6 




StDokey II 


89,5 


90.3 


87 


4.2 


67 



Figure I. Cloniparison of Bn ;ic Skills. Assignments 'lurned In, and Attendance of Groups. 




('roup 1 (iroup II 



Figure 2. C^oniposition of (iroups l)y Year in School 
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The Hypothesis 

The act of writing encourages a personal response by the student. He 
[or she] must assume a chosen position, he must involve himself in the 
subject — he must think. Expressive writing allows him to think in his 
own language, to sort out what he does know from what he is still con- 
fused about, aiid to do so without intimidation from a teacher-examiner 
It seems reasonable that students who have been encouraged to use ex- 
pressive writing as a vehicle to transport themselves through the ''think" 
part of scientific methodology will not only learn more, but will retain 
what they have learned to a greater degree than those students who have 
not used expressive writing to sort out their thoughts. 



The Procedure 

My two biology classes (69 students) were designated as Group I. Harry 
Stookey's two classes (G7 students) were designated as Group U. The 
students remained with the same teacher for the entire year. Group I 
served as the experimental group during the (irst semester while Group 
n served as control. The roles of the groups were reversed for the sec- 
ond semester Thus each teacher served as director of an experimental 
group and a control group. We hoped this procedure would negate the 
teacher as a variable in the experiment. 

Both experimental and control groups covered the same biology top- 
ics at the same time, did the same labs, watched the same educational 
films, and had homework assignments corrected with a stress upon 
proper word usage and spelling. 

The differences between the experimental group and the control 
group are shown in the following chart: 



Procedural Differences Between the Experimental 
and Control Groups 





'perimmtal Oroup 


Contra' Group 


1. 


reading logs 


\. 


no reading logs 


2. 


neuron notes 


0 


no neuron notes 


3. 


practice essays 


3. 


no practice essays 


4. 


writing to a specific audience 


4. 


writing to the teacher as an 




other tlian the teacher 




examiner 


5. 


end of class smTiniarics 


5. 


no end of class summaries 


(). 


group writing 


(i. 


limited group writing 


7. 


essay tests 


7. 


multiple-choice tests 
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'Evo units were selected as "test units," i.e., subject matter to be tested 
and the results compared. The test unit for the first semester was ge- 
netics. Genetics was selected because it was scheduled far enough into 
the semester to allow time to acquaint the students with the writing tech- 
niques to be used. The unit was three weeks long. A pretest (multiple- 
choice) was given just before the Thanksgiving holiday on November 
24th, prior to starting instruction about genetics. A posttest (the same 
multiple-choice test) was given after the unit, on December I9th, just be- 
fore the Christmas holiday. On April 10th, 16 weeks after the completion 
of the genetics unit, a recall test (the same multiple-choice test) was given 
to determine how much of the genetics unit had been retained by the 
students. 

Although we used essay tests as an additional way of utilizing writing 
to learn in the instruction of the experimental group (see pp. 156-58) 
multiple-choice tests were used instead of essay for pre- and posttesting 
of both groups for the following reasons: (I) most standardized tests are 
multiple-choice and most of our questions came from textbook exams; 
(2) essay tests may not have been fair to the control group; (3) most bi- 
ology classes use multiple-choice tests. 

The test unit for the second semester, when Harry Stookey's class 
served as the experimental group, was seed plants. The pretest was 
given on April 17 th. The students took the posttest on May 8th. The re- 
call test was given to the students on May 29th, three weeks after the unit 
had been completed. Since the school year was about to end we were un- 
able to extend the period between post and recall examinations any 
longer than three weeks. 

The expressive writing exercises used by the experimental groups, 
and the results of those exercises, are described below. 

The Reading Logs 

Reading Logs were assigned in an effort to improve reading compre- 
hension and provide opportunity for expressive writing. The students 
were instructed to record their thoughts, on notebook paper, as they 
read, as some people do in the margins of books. The notes were to be 
thoughts or impressions, they were not to be an outline of the reading. 
The students knew the teacher would not read their Reading Logs. 
When due, the students held up their Reading Logs to show that they 
had been completed and then filed them in personal folders which were 
kept in the classroom but were available to the students at any time. 

An anonymous poll of student reaction to the Reading Logs was taken 
in mid-March. The students were told to rate the value of Reading Logs 
on a scale of zero to ten on which zero represented "of no value at all" 
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and ten represented "extremely valuable/* The reactions of the students, 
after some initial groans and mumblings about more homework, was 
mixed. The following scale represents the average value given to the 
Reading Log by each of the groups: 

0123456789 10 
I \ \ 1 \—\ \ 1 h-t \ \ 1 

Group II Group I 

(Stookey) (Tierney) 

Some of the anonymous student comments appear below: 

I think the reading log is very useful if you have to write about 
the chapter then your going to read it. If you write a paragraph or 
two of something you just read, then it stays on your head a lot 
longer then just reading it and forgetting it, 

— A student in Group 1 

The RL was a pain mainly because I ended up doing them one 
hour or so before they were due. For the most part 1 would say they 
weren^t helpful to me because of unwillingness to do them before 
class and consequently I merely rushed to get them done and not 
fully understanding what I read or wrote. Admittedly they are a 
good idea, but they shouldn't be used as an assignment because stu- 
dents will BS their way through them, I believe they should be used 
as an extra-credit, or very carefully read. In this way they would be 
fully effective, 

— A student in Group I 

I think they are great. They are sort of a reward for studying. 
Not because they are worth five points, but because they help you 
where you need it most, on the test, 

— A student in Group II 

The reading logs don*t help at all for me, I think they make read- 
ing the chapter harder because you have to stop and right down 
stuff, 

— A student in Group II 

The Neuron Notes 

Many professional writers keep dailyjournals. The British seem to have 
success with "Learning Logs,"''^ It sounded like an excellent idea. We 
called our version of writing-to-thin k Nmron The Neuron Notes 
provided another opportunity for expressive writing and forced the stu- 
dent to organize his thought, to sort out what he learned from what he 
was confused about. 

I5d 
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The students were instructed to take at least ten minutes each day to 
sit down and attempt to explain, to themselves, what they had learned in 
biology that day. They were encouraged to write down any thoughts that 
occurred to them even if they regarded the thought as trivial or non- 
sense. They were also encouraged to pose questions for the teacher 
about things that confused them. Though Neuron Notes would not be 
read by the teacher without student permission, we hoped that many 
students would use them as a vehicle for individualized instruction. 

Although 90% of the students wrote Neuron Notes, only a few 
granted permission to have them read; most of those were regurgita- 
tions of what had been presented — not what was actually learned. They 
were expressed in a style designed to please the teacher. Most students 
were unable to overcome the idea of writing for a grade. 

A few excerpts from Neuron Notes follow: 

lb day, we watched a movie on genetics. Considering it was an old 
movie, it was pretty interesting. It explained how the genes are 
passed on from generation to generation through heredity. It talked 
about Mendel's work and how he came to be the father of genetics. 

The most interesting part was when it showed the different stages 
of mitosis. I have a clearer view of how mitosis works by being able 
to see the changes from interphase to metaphase, etc. 

It's also possible for scientists to actually see the genes lined up 
on a chromosome of a fruit fly They know this because when a cer- 
tain gene wasn't present, that trait didn't show up. 

— A student in Group II 

I guess I didn't understand the punnett square as well as I 
thought I did. The thing I don't understand is if it's stated that 
something is homozygous does that mean that it's dominant or re- 
cessive? ril ask Mr. T. what that means. 

— A student in Group I 

We watched a movie about genetics. It showed the idea of our 
book in different ways. If somebody did not already know what was 
going on it would be hard to follow. I followed it pretty well. 

— A student in Group II 

They explained about MendeKs experiment and I would explain 
it again on paper but iVe written about it so many times I know it 
by heart. 

— A student in Group I 

In biology today we first took a quiz. It was based on what we 
learned yesterday: monohybrid and dihybrid crosses. I missed 
problem one all together. I didn't miss it because I didn't know the 
way to work it. I missed it because I got nervous and confused a little 
because it was in word problem form. It was asking about the cross 
of a black heterozygous pacing horse with a black heterozygous 
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trotting horse. I misread heterozygous as homozygous. The result 
was that my missing the whole problem, wow was I ever mad at 
myself. 

— A student in Group I 

An anonymous response to Neuron Notes was solicited from the stu- 
dents in mid-March, the same day they evaluated the Reading Logs. A 
rating of zero indicated the students thought Neuron Notes had no 
value. A rating of ten indicated that Neuron Notes were invaluable as a 
learning device. The average rating of Neuron Notes by each group is 
shown on the scale below: 

(Tierney) 
Group I 

0123456|789 10 

1 ] \ \ \ \ — H ^ ^ ^ ^ 

Group II 
(Stookey) 

Some written response to the evaluation of Neuron Notes follows: 

To say quite honestly I never gave the Neuron Notes a fair chance. 
A lot of times I wouldn't get them done so I couldn't really say if they 
would have helped me or not but I did feel they were a good idea. 

— A student in Group II 

I thought the Neuron Notes were beneficial to me during the ge- 
netics part of the course. They made me sit down and determine 
what I learned and if I was confused to go back and review or ask 
Mr Tierney. I think they should be required through other phases 
of biology. Why can't we do them all year? 

— A student in Group I 

Neuron notes had a great effect on my learning habits. If I re- 
member what I did each day and can explain it, I usually remember 
more, and more clearly. 

— A student in Group II 

The neuron notes helped me some but not as much as the Read- 
ing Logs did. Somedays you wouldn't learn anything so you would 
just put a lot of bull dc . n. I was never that enthused about the neu- 
ron notes so I just did it half assed all of the time. 

— A student in Group I 

The Practke Essays 

Science teachers often ask students to write essay-type responses or re- 
ports, but seldom take any time to explain to the student how to write 
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one. We mistakenly assume that teaching essay writing is solely the task 
of the English teacher We expect the student not only to know how to 
respond in essay style, but we ask him to write his response without any 
prior 'Varmup" or "think-it-through" time. We then correct the stu- 
dent's paper as if it were a final draft, forgetting that few professional 
writers write a finished piece on the first try. 

The teacher assigning an essay should write an essay response to his 
own question before assigning it to the students. He should allow suffi- 
cient time for the student to think through the problem. Since exami- 
nations for the experimental group were essay type (except for the 
objective tests used for research purposes), we tried to provide instruc- 
tion and practice in essay writing. We called this instruction Practice 
Essays. 

The students were told to read the topic carefully and to make any 
notes they wished, i.e., make a short Reading Log. The students then 
shared their notes with each other and deleted or added items. Some 
students volunteered to read their notes aloud; other students were al- 
lowed to add items to their own lists. They were then given twenty min- 
utes to write about the topic. They were told it was a first draft and not 
to be concerned about spelling, grammar, or mechanics. A few of the pa- 
pers were read aloud for class reaction and comment. The Practice Es- 
say sessions usually took place about a week before the actual exam. 

When polled later 75% of the students thought that Practice Essays 
were very helpful, especially in learning how to take an essay exam. Neg- 
ative reactions came from about 15% of the class while 10% had no opin- 
ion. A few anonymous comments follow (all from Group I): 

I think the practice essay helped me alot. I think it is a very wise 
study habit. If I were to not write a practice essay I would probably 
do worse. After I write the practice essay I read it to myself and 
write things down or rewrite things that I forgot or just needed to 
make more sense. The practice essay helps alot! 

I feel it is much better to do such a practice SA is a very good idea. 
Wow this doesn't mean I enjoyed, no way. It was, as I suspected, 
hard work, but considering it is the first time I have received an A 
in any kind of science test (at least for as long as I can remember) I 
feel any amount of hard work is worth it (up to a point). 

I would like to admit something that I never would admit to class- 
mates. Instead of feeling nervous only about the test, for a strange 
reason I felt it a challenge. I feel it to be a good idea. 

The practice essay was very great! I learned the material much 
better and it still stays with me. I've learned more by practice essay 
than by just failing the test. I don't fail the tests since we have prac- 
tice essays. The class is not boring like most classes are. 
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1 think the SA test was a waste. I would rather read a chapter out 
of the book because you can get more information. While writing 
up the SA you just don't absorb all information. 

Writing for a Specific Audimce 

British studies indicate that 87% of all student writing in science is writ- 
ten to the teacher as an examiner^ — informing the already informed. It 
was no great surprise to see that our students were writing to the same 
audience despite frequent suggestions not to do so. Grade-conscious 
students feel compelled to tautologize what the teacher has told them, or 
to write reports that sound like, and often are, copies from the textbook 
or encyclopedia. 

Our alternatives to writing to the teacher as an examiner included: 
(1) letting the student write to himself as much as possible (Reading 
Logs and Neuron Notes); (2) having the student write for his peers 
(group labs); (3) having the student write to the teacher as a partner 
(Neuron Notes that students asked the teacher to read); (4) having the 
student pretend to write to a particular person other than the teacher. 

The fourth method was accomplished by placing a large photo, or 
poster, on the wall and asking the student to write for the person de- 
picted on the poster. Sometimes the students wrote for Miss Piggy, Won- 
der Woman, Evel Knievel, a clown, a boy on a skateboard, a bum in a 
doorway, an old lady on a porch. Superman, and so on. There were fre- 
quent discussions regarding how much the person in the poster might 
be expected to know about a particular subject. Wonder Woman, it was 
agreed, probably knew everything, but Miss Piggy would not be ex- 
pected to know, or care, about the respiration cycle of a cell. These dis- 
cussions turned out to be excellent review sessions. 

The following are excerpts from papers written to a boy on a skate- 
board. The subject is mitosis and meiosis. Teacher comments follow 
each excerpt. 

I'm going to explain meiosis to you buddy. It starts out with one 
cell, with a nuclear membrane. The first stage is that the membrane 
disintergrates and chromosomes are visible, two more chromo- 
somes are duplicated, and line up right next to each other, then they 
start twisting up to mix up the genes. All of them line up on the 
equater and then split into two cells, each carrying two chromo- 
somes, then those two split up again forming four more cells, each 
have four cells which have one chromosome. This is called haploid. 

TEACHER COMMENT: This student starts by addressing the poster, 
but quickly slips into writing to the teacher as an examiner. His view of 
what takes place in cell division is a bit distorted. 
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Mitosis is a term that applies to the splitting of all cells higher 
than bacteria and not including sex cells. In mitosis the nuclear 
membrane (a thin wall that covers the nucleus, the control center of 
the cell) is broken down and distributed throughout the cell. Next 
the chromosomes of the cells (chromosomes are the bodies in the 
nucleus that control what you will look like, do, etc.). 

TEACHER COMMENT: This student makes an attempt to explain 
some of the terminology to the boy on the skateboard. 

Dear Young man on the skateboard: 

1 am going to try to explain about mitosis and meiosis. Mitosis is a 
process that happens when all cells duplicate themselves except sex 
cells. It starts when the cell nucleus starts dissolving and the chro- 
mosomes are present. They duplicate themselves and turn so that 
they are horizontal with the poles. Then they begin to split and half 
go to '^ne pole and half to the other pole. The cell then makes a du- 
plic U ' jf itself. 

TEACHER COMMENT: This is the voice of a high school biology stu- 
dent attempting to clarify the idea in his own terms. It's reasonably accu- 
rate, but probably confusing to his reader. 

1 here are three methods of cell division. One of them is fission 
and the others are mitosis and meiosis. Mitosis occurs in more ad- 
vanced cells, and meiosis occurs only in sex cells. In mitosis there 
are several stages the cell goes th rough before it divides to form two * 
cells exactly like it. In meiosis, the cell goes through various steps to 
form four cells. Mitosis and meiosis both involve chromosomes. 

TEACHER COMMENT: This sounds like expressive writing that takes 
place as the student tries to clarify the idea to himself. He's learning. 

Mitosis is the splitting up of a cell with a full set of chromosomes. 
Mitosis can split up all higher level of cells except sex cells. Sex cells 
are split up by a process called meiosis. 

TEACHER COMMENT: The student has grasped one idea, but has ig- 
nored his reader and is writing to the teacher. 

I'm sorry to tell you that I was sleeping during the lecture and 
did not have a thing to write. However you should get enough infor- 
mation from the other people that are writing to you, if they know 
anything. Please do not read this letter while skateboarding or when 
your doing anything else. Please disregard this letter, burn it up, or 
throw it away just get rid of it. 

TEACHER COMMENT: Refreshingly honest. The student is writing to 
the skateboarder, but is also apologizing to me for not paying attention. 
It tells me something about the student and/or my ability to lecture. 
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1 can't explain mitosis very well for I don't understand it yet, my- 
self- But I will try to attempt to explain meiosis. Meiosis is a process 
in which sex ceils are produced, if you have one cell which has 46 
chromosomes inside of it the chromosomes split up in half, 

TEACHER COMMENT: A confused voice, but being able to admit you 
don't know is the first step toward learning something. It also informs 
me that I had better review the subject with the entire class. 

End of Class Summaries 

Sometimes, after a teacher presentation, the students were asked to take 
the last fifteen minutes of class to summarize what they had learned 
about the topic presented. This activity was similar to Neuron Notes ex- 
cept that the student turned it in for credit. The student received full 
credit if he did it, regardless of content or how well written, and zero 
credit if he did not turn it in. 

Besides an additional opportunity for expressive writing, it provided 
a real insight into how much of the teacher presentation is being ab- 
sorbed. It also keeps the class alert and can provide a break in routine. 

The following are examples of student summaries after a discussion 
of cell respiration, a difficult and not very exciting topic: 

I don't understand this stuff. 

I understand most of what happens in respiration. One thing I 
don't understand though, is where the carbons go when you lose one 
or two. Also, where does the CO2 + HoO come from when you lose 
carbons? 

What I know about respiration is that all organisms need it. The 
carbon from glucose is taken and split in two. You take one of the 
two and it is split into two carbons, the one carbon is used to make 
COo and HjjO comes out, also. Those were the first steps or the 
anaerobic stage, it needs no oxygen and happens outside the mito- 
chondria. The aerobic stage needs oxygen and happens in the mi- 
tochondria. The mitochondria forms 4C which combines with the 
2C. They form 6C. It's split into 5C, carbon forms COo and H.^0. 

Sometimes the end of class summary provided an insight different 
from what was perceived by observing the class. They may all have 
looked as though they understood, but the summaries often revealed 
they did not. We knew when we had to cover the material again. 

Group Writing 

Group writing took place when students worked as a team while doing a 
lab. Sometimes the team consisted of two students, sometimes three. 
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Only one paper was required from the group so the writing effort was 
a team product. We kept everyone honest by occasionally giving an un- 
announced quiz immediately after the lab was turned in. Students who 
worked at understanding the lab were rewarded; those who didn't do 
their share generally lost points. 

Another type of group writing occurred when we organized the class 
into teams in order to solve a problem. Harry Stookey and I, over the 
years, have developed several group pi oblem-solving assignments. One 
that was used during this experiment involved trying to determine why 
the oxygen curve on a lake in San Francisco did not drop very much dur- 
ing the hours of darkness. 

We organized the students into teams, taking care to distribute the 
talent, and presented them with the problem and the data available. As 
a team they had to formulate a hypothesis, interpret the data, and make 
some conclusions. They were given parts of several days in class. They 
also met frequently outside of class. They were told, at first, that each of 
them must write a first draft and attempt to solve the problem. Later 
they would get together and review and discuss each other's papers. 
Then, as a team, they wrote a report that was turned in for grading. 

The sharper students seem to enjoy these assignments. There is gen- 
erally good discussion and cooperation between students in a team, but 
sometimes one student may dominate the others, resulting in the paper 
being written by the most grade-conscious student in the team. 

There are many biological principles that enter into the problem 
posed, and the exercises are generally excellent for reviewing material, 
stimulating ideas, giving students some problem-solving experience, and 
teaching the nature of science. On occasion the students might argue 
with our interpretation of a correct answer, and that makes it an inter- 
esting challenge for both teachers and students. 

Designing one of these assignments is a stimulating experience. It's a 
chance to be creative. Unfortunately it takes lots of time and time is 
scarce. 

Essay Examinations 

All examinations for the experimental group were essay type except the 
tests given to evaluate the experimental test units (genetics for Group I; 
seed plants for Group II). 

Several days prior to the examination the students were given practice 
essay instruction and had a good idea about what might be asked. 

The following questions are typical of the essay questions asked: 
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A. Describe Francisco Redis experiments. Remember to: state his prob- 
lem; his hypothesis; his procedure, incliicling the control used; his 
results; his conclusions. 

B. Brieji'^ summarize the variinus hypotheses concerning the development of 
life on earth. Select one hypothesis and defend or refute it. 

C. Explain, in as much detail as you can, how the leaf of a plant is adapted 
for photosynthesis. Remember what is re(]ui\'ed For photosynthesis 
and be sure to explain how the structure of the leaf is suited for 
these requirements. 

In order to evaluate the examination, we first wrote the essays our- 
selves in order to make certain we looked for particular things and did 
not reward the glib student who wrote well, but didn't really know the 
material. Oar essay also served as a model for student appeal when the 
tests were returned. We read our essay to the class, and if some student 
thought we'd made a mistake on his grade he challenged us by reading 
his essay aloud. After a discussion, his grade might be altered, either up 
or down. The discussions were often lively and generally involved the en- 
tire class. 1 thought they became one of our best learning situations. For 
fun, I kept score on the blackboard, labelling the scoreboard as "NEAT 
TEACH" and "PUNKS." If the student lost a point I placed a score un- 
der "NEAT TEACH." If the student won a point it was credited to the 
"PUNKS." Although keeping score was designed for fun, it served to 
eliminate some student reluctance in challenging the authority of the 
teacher. The students invariably scored more points than the teacher, 
and they looked forward to the test reviews. Their eagerness motivated 
me to return their tests as promptly as possible. 

Generally speaking the students complained bitterly about essay ex- 
aminations at first. They often reminded me that biology was not sup- 
posed to be an English class. It was interesting, and very satisfying, to 
hear them ask for essay examinations when my group became the con- 
trol for the experiment and started using multiple-choice tests. 

The essay examination requires a lot of work on the part of the 
teacher, but we felt it more truly reflected what the students knew about 
the subject. It rewarded those who prepared. It's also another way to 
teach writing in the biology class. 



Results 

The results of the test units (see graphs, pages 164-65) were, for the 
most part, expected. The pretest for both units, genetics and seed 
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plants, indicated that the previous subject matter knowledge of both 
control and experimental groups was about the same. The results of the 
posttests were disappointing, though not unexpected. Since Group II 
seemed to have more maturity and scored higher on basic skills tests, we 
expected them to do slightly better than Group L It was hoped, however, 
that the writing efforts of Group I might compensate for the difference 
in basic ability between the two groups. Apparently it didn't. Post-exam 
results for both experimental test units were very close. 

The recall tests, given sixteen weeks after the first unit and three 
weeks after the second, did, however, indicate a clear difference between 
experimental and control groups. The experimental groups scored no- 
ticeably higher on recall than the control groups. 

Conclusions 

Apparently students in classes where expressive writing is stressed will 
score about the same on a particular unit multiple-choice examination 
as students who are not in a class that emphasizes expressive writing. 
"School-wise" students learn to memorize what they need to know for a 
particular test. It would be interesting to see how the groups would have 
scored if essay tests had been used to evaluate the two units used for 
comparison in this experiment. 

The results of this experiment clearly indicate that students who have 
been given an opportunity to use expressive writing as a learning tool 
will rel;ain more of what they have learned. 

Although the experiment was not designed to evaluate improvement 
in student writing, we feel that student writing did improve. If nothing 
else, students became aware that what they learn in their composition 
classes does apply in other segments of the curriculum. Another exper- 
iment, to assess writing improvement, should be developed and carried 
out. 

It seems clear to us that biology teachers who stress expressive wridng 
will work harder, have a heavier paperwork load, and will have to delete 
some biology topics from their program to allow time for writing. They 
will probably derive more satisfaction from their teaching experience, 
however Their students will learn the subject matter presented more 
thoroughly, and their papers, reflecting what the student actually un- 
derstands, will be more interesting to read. The teacher will be able bet- 
ter to assess his own performance and enjoy the satisfaction of seeing his 
students learn the principles of biology, improve their basic writing skills, 
and enjov the class. 
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Results, Multiple-Choice Pre, Post, and Recall Test — Genetics 

(Based upon mean average test scores expressed in percent correct) 
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Results, Multiple-Choice Pre, Post, and Recall Test— Seed Plants 

(Based upon mean average test scores expressed in percent correct) 
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Harry Stookey and I, impressed by the results of this experiment, will 
continue to use the expressive writing techniques cited in this paper 
with the following modifications: 

L Neuron Notes will not be assigned every day and they will be read 
by the teacher We will not correct the papers, but will attempt to 
carry on a written dialogue with the student to increase his under- 
standing of the subject. 

2. The Neuron Notes activity used in combination with End of Class 
Summaries, has a lot of potential for individualized instruction. We 
will continue to refine and develop this technique by increasing the 
number of End of Class Summaries and decreasing the number of 
Neuron Notes, 

Perhaps what Harry Stookey and I have accomplished with this ex- 
periment is a pilot study that may stimulate others to experiment. We 
certainly gained some valuable insights into our own teaching methods; 
it was worth our time and effort. 

From Tioo Studies of Writing in High School Science, ed, Ann Wotring and Robert Tiernc); 
© I98I Bay Area Wridng Project, Reprinted by permission. 

Notes 

1 . To differentiate the "writing for learning" utilized for tiie purpose of this 
study from the usual forms of expository writing required in biology 
classes, I have adopted the functional categories described in Nancy Mar- 
tin, et al.. Writing and Learning Across the Curricidun 11-16 (London: 
Ward Lock Educational, 1976), pp. 22-23. Briefly, they define tramac- 
tional writing as writing "in which it is taken for granted that tlie writer 
means what he says and can be challenged for its truthfulness to public 
knowledge; . . . the language most used in school writing." Expressive 
writings by contrast, is more like written-down speech, writing in which 
the writer "feels free to jump from facts to speculation to personal an- 
ecdote to emotional outburst and none of it will be taken down and used 
against him." It is this latter sort of writing we encouraged students to use 
as a learning tool in our classes. 

2. Writing in Science, Papers from a Seminar xuith Science Teacheis, London: 
Schools Council Publications, 1976. 

3. Ibid. 
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